The ABINIT Users Mailing List ( CLOSED )

[Luigi Genovese <luigi.genovese@gmail.com>]

On Mon, Sep 21, 2009 at 1:29 PM, Jyh-Shyong <c00jsh00@nchc.org.tw> wrote:
> Luigi Genovese 提到:
>>
>> Have you did "make clean" before?
>>
>> It seems that the previously compiled routines were still without the
>> second underscore.
>>
>> Let me know
>>
>> Luigi
>>
>>
>
> Hi Luigi,
>
> Thanks, I tried again from the source, and it works, the compilation of
> bigdft 1.3 with cuda and mpi
> completed without error.
>
> However, the configure script of abinit-5.8 does not have the
> -enable-cuda-gpu option for bigdft, how
> do I specify this option when I configure abinit so that the plugin bigdft
>  can be built with cuda support?
> By the way, each node of my GPU cluster has 2 or 4 C1060 GPU cards, I wonder
> if bigdft can use
> more than one GPU?  if yes,  where is the device assigned?

yes, there is an example in the tests/GPU subdirectory.
GPU can be specified in the GPU.config file which must be present in
the same directory as input.dft file (BigDFT standalone version does
not have the same input files as abinit)


If you want to run a calculation for a system which has 8 MPI
processes and 2 GPU per node you have to put these line in the
GPU.config:

USE_SHARED=1

MPI_TASKS_PER_NODE=8
NUM_GPU=2

GPU_CPUS_AFF_0=0,1,2,3
GPU_CPUS_AFF_1=4,5,6,7

USE_GPU_BLAS=1
USE_GPU_CONV=1

In that way the cores with the different IDs in the node (hard coded
on the node) are associated (affinity) to different card.
In this example CPUs 0,1,2,3 will share the same GPU (0) as co-processor.
Calculation and data transfers are then executed in an asynchronous
way to avoid overlapping.

Another approach is a static assignation (USE_SHARED=0), but in that
case the number of tasks must be lower than the number of GPU, and in
that case the affinity is ignored.

I hope it will help

Luigi

>
> Best regards
>
> Jyh-Shyong Ho
>
>