Parallel job characteristic analysis toolkit based on job accounting logs:JobCAT
CSTR:
Author:
Affiliation:

(1. Institute of Applied Physics and Computational Mathematics, Beijing 100094, China;2. CAEP Software Center for High Performance Numerical Simulation, Beijing 100088, China)

Clc Number:

TP315

Fund Project:

  • Article
  • |
  • Figures
  • |
  • Metrics
  • |
  • Reference
  • |
  • Related
  • |
  • Cited by
  • |
  • Materials
  • |
  • Comments
    Abstract:

    Characteristic analysis of parallel job is the basics of workload analysis research. Job accounting log is an important data source of job characteristic analysis, however, existing tools cannot do statistics analysis with application name, because of application name not recorded in job accounting log. To solve this problem, a novel marking method for job accounting log was proposed, which based on keyword fuzzy matching. Combined with a general job data model and a flexible extensible software architecture, a parallel job feature analysis tool JobCAT was implemented. According to verification test by millions of job accounting log data from a supercomputer system, the log marking rate of JobCAT was greater than 95%. JobCAT supports 7 plugins and 29 statistical reports, and can easily make analysis report classified by application name, which has practical value to workload analysis research.

    Reference
    Related
    Cited by
Get Citation
Share
Article Metrics
  • Abstract:
  • PDF:
  • HTML:
  • Cited by:
History
  • Received:December 29,2021
  • Revised:
  • Adopted:
  • Online: September 28,2022
  • Published: October 28,2022
Article QR Code