Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DeePMD-kit #487

Open
boegel opened this issue Jan 6, 2025 · 9 comments · May be fixed by easybuilders/easybuild-easyconfigs#22217 or easybuilders/easybuild-easyconfigs#22219
Open

DeePMD-kit #487

boegel opened this issue Jan 6, 2025 · 9 comments · May be fixed by easybuilders/easybuild-easyconfigs#22217 or easybuilders/easybuild-easyconfigs#22219
Assignees
Labels
C/C++ C/C++ software difficulty: medium software that likely require a fair amount of effort to support GPU new new software priority: high Python site:t1_ugent_hortense Software installation request for Tier-1 Hortense

Comments

@boegel
Copy link
Contributor

boegel commented Jan 6, 2025

@boegel boegel added difficulty: medium software that likely require a fair amount of effort to support C/C++ C/C++ software new new software priority: high Python site:t1_ugent_hortense Software installation request for Tier-1 Hortense labels Jan 6, 2025
@boegel
Copy link
Contributor Author

boegel commented Jan 6, 2025

@lexming @smoors Does this ring a bell for you?

The person who requested it mentioned that it's already available on Hydra...

@boegel
Copy link
Contributor Author

boegel commented Jan 6, 2025

I've asked for some more input from the person who requested this: which installation they're using on Hydra @ VUB, and how they're using this exactly (since it seems like there's a bunch of options when installing it)

@boegel
Copy link
Contributor Author

boegel commented Jan 7, 2025

Try on top of foss/2023a with TensorFlow + PyTorch + jax as dependencies.

Try first CPU-only, then also with GPU/CUDA if that works.

Start with max. 2 hours to see how far you get.

@smoors
Copy link
Collaborator

smoors commented Jan 7, 2025

@lexming @smoors Does this ring a bell for you?

The person who requested it mentioned that it's already available on Hydra...

don't think we have it, the user indicates he was wrong..

@boegel
Copy link
Contributor Author

boegel commented Jan 7, 2025

More details on requirements:

Considering the backends: DeePMD is most often combined with TensorFlow (tensorflow or
tensorflow-gpu), so I recommend installing it with that option. If that doesn't work,
the second option would be PyTorch although this is less preferred. Dpdata is
optional, but preferred. Compiling with C++ is a must (so it can interphase with
LAMMPS later for validation).

@pavelToman So, give it a try with TensorFlow + PyTorch + jax, and quickly focus on TensorFlow if either PyTorch or jax are problematic for some reason.

@pavelToman pavelToman self-assigned this Jan 7, 2025
pavelToman added a commit that referenced this issue Jan 10, 2025
pavelToman added a commit that referenced this issue Jan 13, 2025
pavelToman added a commit that referenced this issue Jan 13, 2025
@pavelToman
Copy link
Collaborator

pavelToman commented Jan 15, 2025

There is the same problem as for Horovod when it run pip install deepmd_kit: #390 (comment)

#error This file was generated by an older version of protoc
#error incompatible with your Protocol Buffer headers
#error regenerate this file with a newer version of protoc.

EDIT: continue with the same protobuf hack

pavelToman added a commit that referenced this issue Jan 15, 2025
pavelToman added a commit that referenced this issue Jan 15, 2025
pavelToman added a commit that referenced this issue Jan 23, 2025
pavelToman added a commit that referenced this issue Jan 23, 2025
pavelToman added a commit that referenced this issue Jan 24, 2025
@pavelToman
Copy link
Collaborator

pavelToman commented Jan 27, 2025

For now I have prepared easyconfigs for:

  1. DeePDM-kit-3.0.1 - python module + c++ module + cpu version + TensorFlow/Jax version
  2. DeePDM-kit-3.0.1 - python module + c++ module + cpu version + TensorFlow/Jax version + LAMMPS (in plugin mode)
  3. DeePDM-kit-3.0.1 - python module + c++ module + gpu version (CUDA-12.1.1) + TensorFlow/Jax version
  4. DeePDM-kit-3.0.1 - python module + c++ module + gpu version (CUDA-12.1.1) + TensorFlow/Jax version + LAMMPS (in plugin mode)

I was unable to build horovod with PyTorch support, so I am unable to build DeePDM-kit with PyTorch support

@pavelToman
Copy link
Collaborator

pavelToman commented Jan 27, 2025

pavelToman added a commit that referenced this issue Jan 28, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
C/C++ C/C++ software difficulty: medium software that likely require a fair amount of effort to support GPU new new software priority: high Python site:t1_ugent_hortense Software installation request for Tier-1 Hortense
Projects
None yet
3 participants