Hp XC System 2.x Software Manuel d'utilisateur Page 33
- Page / 154
- Table des matières
- MARQUE LIVRES
Noté. / 5. Basé sur avis des utilisateurs
2.3 Launching and Managing Jobs Quick Start
This section p rovides a brief description of some of the many ways to lau
nch jobs, m a nage jobs,
and get information about jobs on an HP XC system. This section is i nten
dedonlyasaquick
overview about some basic ways of running and managin g jobs. Full info
rmation and details
about the HP XC job launch environment are provided in the SLURM chapte
r(Chapter6)and
the LSF chapter (Chapter 7) of this manual.
2.3.1 Introduction
As described in Section 1.4, SLURM and LSF cooperate to run and manage jobs on the HP
XC system, combining LSF’s pow erful and flexible scheduling functionality with SLURM’s
scalable parallel job launching capabilities.
SLURM is the low-level resource manager and job launcher, and performs processor allocation
for jobs. LSF gathers info rm ation about the cluster from SLURM — when a job is ready to be
launched, LSF creates a SLURM node allocation and dispatches the job to that allocation.
Although jobs can be launched directly using SLURM, it is r ecom men ded that yo u use LSF
to take advantage of its sched uling and job management capabilities. SLURM options can be
added to the LSF job launch command line to further define job launch requirements. The
HP-MPI mpirun command and its options can be used within LSF to l aunch jobs that require
MPI’s high-performance message-passing cap abilities.
When the HP XC system is installed, a SLURM partition o f nodes is created to contain LSF
jobs. This partition is called the lsf partition.
When a job is submitted to LSF, the LSF scheduler prioritizes the job and waits until the
required resources (compute nodes from the lsf partition) ar e available.
When the requested r
esources are available for the job, LSF-HPC creates a SLURM allocation
of nodes on behalf of
the user, sets the SLURM JobID for the allocation, and dispatches the
job with the LSF-HPC
JOB_STARTER script to the first allocated node.
A detailed explanation of how SLURM and LSF interact to launch and manage j obs is provided
in Section 7.1.4.
2.3.2 Getting Information A bout Queues
The LSF bqueues command lists the c o nfigured job qu eues in LSF. By default, bqueues
returns the following information about all queues: queu e name, queue priority, queue status,
job slot statistics, and job state statistics.
To get informatio n about queues, en ter the bqueues as follows:
$ bqueues
Refer to Section 7.3.4 for more i nform ation about using this co mm and and a sample of its output.
2.3.3 Getting Information About Resources
The LSF bhosts, lshosts,andlsload commands are quick ways to get information abo ut
system resources. LSF daemons run on only one node in the HP XC system, so the bhosts
and lshosts commands will list one host — which represents all the resources of the HP
XC system. The total n um ber of processors fo r that host should be equal to the total n um ber of
processors assigned to the SLURM lsf partit ion.
•TheLSFbhosts com m a nd provid es a summary of the jobs on the system and information
about the current state of LSF.
$ bhosts
Refer to Section 7.3.1 for more info rm a tion about using this command and a sample of
its output.
Using the System 2-7
- HP XC System Software 1
- Contents 3
- 3 Developing Applications 4
- 4 Debugging Applications 5
- 5 Tuning Applications 5
- 6UsingSLURM 5
- 8UsingHP-MPI 6
- 7 Using LSF 6
- 9UsingHPMLIB 7
- 10 Advanced Topics 8
- AExamples 8
- About This Document 11
- HP XC Inform ation 12
- For M ore Information 13
- Supplementary Information 13
- Manpages 14
- Related Information 15
- Typographical Conventions 16
- HP Encourages Your Comments 17
- 1.1 System Architecture 19
- 1.1.3 Storage and I/O 20
- 1.1.4 File System 20
- 1.2 User Environment 22
- 1.3.1 Parallel Applications 23
- 1.3.2 Serial Applications 23
- 1.4 Run-Time E nvironment 24
- 1.4.4 HP-MPI 25
- Using the System 27
- 2.2.1 Notes on Modulefiles 28
- 2.2.2 Supplied Modulefiles 29
- 2.2.6 Loading a Modulefile 30
- 2.2.7 Unloading a M odulefile 31
- 2.2.8 Modulefile Conflicts 31
- 2.2.9 Creating a Mod u lefile 32
- 2.3.1 Introduction 33
- 2.3.5 Launching Jobs 34
- $ man sinfo 39
- $ man -k keyword 39
- Using the System 2-13 39
- Developing Applications 41
- 3.2 Using Compilers 42
- 3.4 Interrupting a Job 43
- 3-4 Developing Applications 44
- Developing Applications 3-5 45
- 3-6 Developing Applications 46
- Developing Applications 3-7 47
- $ module load mpi 48
- $ mpicc -o mycode hello.c 48
- $ mpif90 -o mycode hello.f 48
- 3-8 Developing Applications 48
- 3.8 Developing Libraries 49
- 3.9 Advanced To pics 50
- 3-14 Deve loping Applications 54
- Developing Applications 3-15 55
- Debugging Applications 57
- 4-2 D ebugging Applications 58
- $ totalview 60
- 4-4 D ebugging Applications 60
- Debugging Applications 4-5 61
- 4-6 D ebugging Applications 62
- -verbosity %V %F" 63
- Debugging Applications 4-7 63
- 4-8 D ebugging Applications 64
- Etnus TotalView Version# 65
- Debugging Applications 4-9 65
- $ mpirun -srun -n2 Psimple 66
- 4-10 Debugging Applications 66
- $ squeue 67
- $ scancel --user username 67
- Debugging Applications 4-11 67
- Tuning Applications 69
- Using SLURM 71
- $ srun -N 16 -b myscript.sh 73
- $ srun -A -N 4 myscript.sh 73
- $ srun -a 6543 -j 73
- Using SLURM 6-3 73
- 6.4.2 srun Signal Handling 74
- 6.4.3 srun Run-Mode Options 74
- Using SLURM 6-5 75
- 6-6 Using SLURM 76
- 6.4.5 srun Control Options 77
- 6.4.6 srun I/O Options 78
- Using SLURM 6-9 79
- 6.4.7 srun Constraint Options 80
- Using SLURM 6-11 81
- 6.4.9 Using srun with HP-MPI 82
- 6.4.10 Using srun with LSF 82
- 6.8 Job Accounting 84
- 6.9 Fault Tolerance 84
- 6.10 Security 84
- Using LSF 85
- 7.1.2 Topology Support 86
- 7.1.3 Notes on LSF-HPC 87
- SLURM_JOBID=53 89
- SLURM_NPROCS=4 89
- 7-6 Using LSF 90
- 7.3.1 Getting Status of LSF 91
- $ bhosts 92
- 7-8 Using LSF 92
- 7.4 Submitting Jobs 93
- 7.4.3 Submitting a Serial Job 97
- Using LSF 7-17 101
- 7-18 Using LSF 102
- Using HP-MPI 111
- 8.3.3 Using srun with HP-MPI 114
- 8.3.4 Using LSF and HP-MPI 116
- 8.3.5 MPI Versioning 117
- 8.6 Truncated Messages 118
- 8.5 32-Bit B uilds on XC4000 118
- Using HP-MPI 8-9 119
- 8.9 Environment Variables 120
- 8.9.5 MPI_PIN_PERCENTAGE 121
- 8.9.6 MPI_PAGE_ALIGN_MEM 121
- 8.9.7 MPI_MAX_WINDOW 121
- 8.9.8 MPI_ELANLOCK 121
- 8.9.9 MPI_USE_LIBELAN 121
- 8.9.10 MPI_USE_LIBELAN_SUB 122
- Work-arounds 124
- Using HP MLIB 125
- 9.1.2 MLIB and Module Files 126
- 9.2.1 Platform Sup port 126
- 9.2.2 Library Support 126
- 9.2.3 MPI Parallelism 126
- 9.2.4 Modulefiles and MLIB 127
- 9.2.6 Compiling and Linking 127
- 9.2.7 Licensing 128
- 9.2.8 MLIB Man pages 128
- 9.3.1 Platform Sup port 128
- 9.3.2 Library Support 128
- 9.3.3 MPI Parallelism 129
- 9.3.4 Modulefiles and MLIB 129
- 9.3.5 Compiling and Linking 129
- 9.3.6 Licensing 130
- 9.3.7 MLIB Man pages 130
- Advanced Topics 131
- Examples 135
- $ lshosts 140
- Show the environment: 142
- Run the job: 142
- View the running job: 142
- View the finished job: 142
- Examples A-9 143
- Glossary 145
- Glossary-2 146
- Glossary-3 147
- Glossary-4 148
- Glossary-5 149
- Glossary-6 150
Produits connexes et manuels pour Logiciel Hp XC System 2.x Software
(41 pages)
(81 pages)© 2020, manymanuals.fr. Tous droits réservés | 0.043 s |
Manymanuals.com
Manymanuals.de
Manymanuals.fr
Manymanuals.it
Manymanuals.pl
Manymanuals.cz
Manymanuals.es
Manymanuals-pt.com
Commentaires sur ces manuels