TODOs.txt

GUIDELINES:
- Avoid modification of nccl.h                      DONE

TODOs:

NCCLS functions:
- ncclGetUniqueId
- ncclCommInitRank                                  Done temp
    - Needs to actually group chosen ranks into new Comm
- ncclCommInitAll
- ncclCommDestroy                                   Done temp
- ncclGroupStart
- ncclGroupEnd
- ncclAllReduce                                     DONE
- map nccl reductions to mpi reductions             DONE
- map nccl datatypes to mpi datatypes               DONE

CUDA Functions:
- cudaMalloc                DONE
- cudaFree                  DONE
- cudaStreamCreate          DONE 
- cudaStreamSynchronize     DONE 
- cudaMemSet                DONE
- cudaGetDevice             DONE

Type Conversion:
- convert NCCL datatypes to MPI datatypes           DONE
    - support for half float and bfloat ??
- convert NCCL Ops to MPI Ops                       DONE
    - MPI DOES NOT SUPPORT AVERAGE
- convert NCCL errortypes to mpi error types

Asynchronousity:
- use asynchronous MPI reduce calls                 DONE

MISC
- Analyze Memory Leaks