Content Comparison

...

• To access the command shell use SSH; to upload files use SFTP or SCP:

  • Host: login.hpc.lab

  • Port: 22

  • Credentials : your Florida Poly username and password

...

Submitting a job to LSF

• Submitting jobs to the LSF (use bsub)

  1. Compile the hello_world example code provided by default

     1. /opt/ibm/platform_mpi/bin/mpicc -o hello_world.exe /opt/ibm/platform_mpi/help/hello_world.c

  2. Submit a job through LSF to test the message passing

     1. bsub -n 10 -R "span[ptile=1]" -o %J.out "/opt/ibm/platform_mpi/bin/mpirun -lsf -vapi /home/(Username)/hello_world.exe; wait"

  3. Check the output of the %J.out file to verify results

...

• To list all available packages:

  • spack find

• To load a package into your environment:

  • spack load

  • You can specify a software version as part of the load:

  • spack load python@3.7.3 loads Python 3.7.3

  Once you’ve loaded Python

Python and PIP

If you load Python using Spack (above) you can use PIP to install

...

other modules:

• python3 -mpip install matplotlib

Apache Hadoop 2.6.0

Apache Hadoop is a collection of open-source software utilities that facilitate using a network of many computers to solve problems involving massive amounts of data and computation. It provides a software framework for distributed storage and processing of big data using the MapReduce programming model.

...