Index and describe flow of ARSC Cray csa scripts in /usr/local/adm/pkg/uakpacct/sbin. These scripts get invoked from csarun typically from csa.user.
vloa == /var/local/output/acct
vloag == /var/local/output/acct/csagcon
vloaC == /var/lcoal/output/acct/cacct.rpt
vloaD == /var/local/output/acct/dacct
vloaJ == /var/local/output/acct/Jobs
asa == /allsys/support/acct
asas == /allsys/support/acct/summary/$HOST
asaJ == /allsys/support/acct/Jobs
current == /allsys/support/acct/Jobs/$HOST/current
asdah == /allsys/support/doc/acct/html
vlsa == /var/local/scratch/acct
uaasr == /usr/adm/acct/sum/rpt
script/process output file(s)
-------------- --------------
i:input
csa.user: # invoked as exit from csarun
Local/csacrep_uacrep.ksh # crep style reporting
lib/csacrep -hjcwxM:
vloa/rpt/*.csacrep
vloaC/*.Sum
Local/disku.ksh # disk usage reporting
lib/diskusg -H -E -a:
vloaD/*.disku.*
disku.nawk:
vloaD/*.files.*
Local/csa_jobs.ksh # job/expansion factor reporting
lib/csagcon -ujac csagcon.$HOST: # consolodation
vloag/c.*
lib/csagfef -f csagfef.arsc: # reduction
vloaJ/o.* # report
vloaJ/g.* # generic format
cd asaJ/$HOST/current
[su sysmon -c]
csa_class.ksh vloaJ/g.*: # add class to jobs
i:asa/tree
csa_class_qa.ksh # Q + Acid to Class
: current/*.Job # generic format w/class
: current/*.Erc # mis-queued gcp
csa_efhiuse.ksh: # Identify high EF
csanawk.arsc:
current/*.Ere
csa_job2use.ksh: # to Group:User
current/*.Use
csa_sum2use.ksh: # sum *.use files
i:*.use
i:ytd.$HOST
current/*.Ytd
csa_alc2use.ksh: # usage vs. alloc
i:asa/alloc.txt
current/*.Alc
: i:*.ytd current/ytd.$HOST
csa_class_rpt.ksh: # html reports
cd asaJ/$HOST
: Job.mtd
: Job.wtd
csanawk.arsc:
Rpt.MTD
Rpt.Week
Rpt.Today
make_html.ksh:
asdah/$HOST.jobs.html (Today)
asdah/$HOST.jobs.7days.html (Week)
asdah/$HOST.jobs.MTD.html (MTD)
: EOM.$EOM
csa_class_eom.ksh: # end-of-month
csanawk.arsc:
make_html.ksh: asdah/$HOST/$EOM.html
ln -s asdah/$HOST.jobs.month.html
(mail): "acct_rpts kcarlson"
Local/csa.ua_mtd.ksh # month-to-date reports
cd vloaC
uacrepmrg: # merge
i:*.Sum mtd
[su sysmon -c] asas/mtd.cacct"
cd vloaD
uadrepmrg: i:*.files.* # merge
mtd # month-to-date
now # today snapshot
[su sysmon -c] asas/mtd.dacct"
[su sysmon -c] asas/now.dacct"
Local/csa.ua_eom.ksh # end-of-month reports/archives
# (1a) Prepare the cacct monthly summary reports
cd vloaC
uacrepmrg: i:*.Sum # merge
[su sysmon -c] asas/$TAG.Sum
csa.tree.ksh # new project tree
[su sysmon -c] asas/tree
uacrep: (temporary files) # report
[su sysmon -c]
make_html.ksh: asadh/$HOST.mon12.html
make_html.ksh: asadh/$HOST.month.html
[su sysmon -c] asa/$HOST/cacctcms.*.tar
# (1b) Prepare monthly job summary reprorts (csagfef)
cd vloag
: previous/*
[su sysmon -c] asa/$HOST/csagcon.*.tar
cd vloaJ
: previous/*
# (2) Prepare the dacct monthly summary reports (diskusg)
cd vloaD
uadrepmrg: i:*.Sum # merge
[su sysmon -c] asas/$TAG.Disk
asa/$HOST/diskusg.*.tar
uadrep: (temporary files) # report
[su sysmon -c]
make_html.ksh asadh/$HOST.disk.html
# (3) Notify interested peoples reports are ready
[su sysmon -c]
csa_eom_html.ksh # reports
csanawk.arsc
: asdah/$HOST.jobs.total.html
make_html.ksh: asdah/$HOST/*.html # FY|Quarterly
csa_hpc.ksh
csanawk.arsc
csa_hpc.arsc # expansion line
csa_hpc.nawk # host averages
make_html.ksh: vlsa/EF_*.html
: asdah/$HOST.jobs.hpcmp.html
: asdah/$HOST/EF_*.html
ln -s asdah/$HOST.jobs.ef.html
(mail): "acct_rpts kcarlson"
# (4) Archive the raw accounting data and session files
cd vloa
[su symon -c] asas/rawacct.*.tar
asas/session.*.tar
(mail): "technical_services"
# (5) Clean-up any residue (e.g., /usr/adm/acct/sum/rpt)
rm -R uaasr/*
Name Invoked by Description
---- ---------- -----------
csa.archive1 csarun Archive raw pacct,etc. files
csa.archive2 csarun Archive the session record file
csa.user csarun csa post-processing user exit
csacrep_uacrep.ksh csarun generate & reformat a cacct report via csacrep
disku.ksh,disku.nawk csarun gather disk usage information for ARSC
csa_jobs.ksh csarun use csagcon and create expansion factor report
csa.ua_eom.ksh csarun archive (tar) accounting and session files
csa.ua_mtd.ksh csarun month-to-date summary
csagcon.chilkoot csa_jobs.ksh csagcon parameter file
csagcon.sv1,csagcon.j90 n/a (doc) used to build csagcon.chilkoot
csagcon.yukon csa_jobs.ksh csagcon parameter file
csagcon.t3e n/a (doc) used to build csagcon.yukon
csagfef.arsc csa_jobs.ksh calculate expansion factors, etc (for t3e|sv1)
produces generic job file
csagfef.chilkoot n/a (old) old j90 specific version used before 2002-10
csagfef.yukon n/a (old) old t3e specific version used before 2002-10
csanawk.arsc csa_jobs.ksh+ re-process generic csagfef job files
csanawk.chilkoot n/a (old) old j90 re-process of csagfef.chilkoot output
csanawk.yukon n/a (old) old t3e re-process of csagfef.yukon output
csanawk.generic n/a (old) old generic job file generation
csa_class.ksh csa_jobs.ksh classify jobs and general job report
csa_class_qa.ksh csa_class.ksh Determine job class from queue and acid
csa_efhiuse.ksh csa_class.ksh report jobs where ef & wallclock exceed
csa_job2use.ksh csa_class.ksh convert a *.Job file to a group/user usage
csa_sum2use.ksh csa_class.ksh sum one or more usage files
csa_alc2use.ksh csa_class.ksh check usage vs. allocation
csa_class_rpt.ksh csa_class.ksh daily (wtd,mtd) job reports
csa_class_eom.ksh csa_class.ksh end-of-month job reports
csa.New2Old csa_class.ksh convert new style generic file to old style
csa.tree.ksh csa.ua_eom.ksh Rebuild project hierarchy tree
csa_eom_html.ksh csa.ua_eom.ksh generate history lines
csa_hpc.ksh csa.ua_eom.ksh generate hpcmp expansion factor report
csa_hpc.nawk csa_hpc.ksh massage (avg) for hpc required statistics
csa_hpc.arsc csa_hpc.ksh produce hpcmp expansion factor summary line
csa_hpc.chilkoot n/a (old) old sv1 expansion factor summary line
csa_hpc.yukon n/a (old) old t3e expansion factor summary line
csa_jobclass.ksh n/a (old) old modify job_file to include classifcation
csarun.short n/a (manual) short csarun to produce a session file