Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

update monitord to parse location records #2096

Open
vahi opened this issue Mar 8, 2025 · 0 comments
Open

update monitord to parse location records #2096

vahi opened this issue Mar 8, 2025 · 0 comments
Assignees
Labels
Monitord Tailstatd monitors the dagman.out file and generates a jobstate.log monitoring file. Additionally it

Comments

@vahi
Copy link
Member

vahi commented Mar 8, 2025

In the PegasusLite output of a job ( in the job.err) file now in addition to multipart integrity records, you have a new type of pegasus-multipart record that captures the location

$ more 00/00/findrange_ID0000002.out.000

- invocation: True
  version: 3.0
  start: 2025-03-07T15:09:56.823-08:00
  duration: 30.599
  transformation: "findrange"
  derivation: "ID0000002"
  resource: "condorpool"
  wf-label: "diamond"
  wf-stamp: "2025-03-07T15:01:09-08:00"
  interface: 
  hostaddr: 0.0.0.0
  pid: 79582
  uid: 3520
  user: vahi
  gid: 337
  group: gridstaff
  umask: 0o0022
  ...
    metadata:
      temporary_name: /opt/condor/8.8.7/local.corbusier/execute/dir_79341/ks.meta.Lgp5nS
      descriptor: 5
      mode: 0o100600
      size: 0
      inode: 421959061
      nlink: 1
      blksize: 4096
      blocks: 0
      mtime: 2025-03-07T15:09:56-08:00
      atime: 2025-03-07T15:09:56-08:00
      ctime: 2025-03-07T15:09:56-08:00
      uid: 3520
      user: vahi
      gid: 337
      group: gridstaff

---------------pegasus-multipart
- integrity_verification_attempts:
  - lfn: "f.b1"
    pfn: "f.b1"
    sha256: 839037d553aebfd8442ea24724a94a1e8fe6b134243c9848527594ba6172ddcc
    success: True
  - lfn: "findrange"
    pfn: "findrange"
    sha256: aae322c0514bad26f6562c7442929abcf2968b3a047e633c9047ae21c738e6fd
    success: True
- integrity_summary:
    succeeded: 2
    failed: 0
    duration: 0.161

---------------pegasus-multipart
location:
    geohash: s000
    ip: 10.101.104.66
    latitude: 0
    longitude: 0
    organization: N/A
    subdomain: ads.isi.edu 

The location record is a json object directly instead of an array for the integrity verification attempts

@vahi vahi self-assigned this Mar 8, 2025
@vahi vahi added the Monitord Tailstatd monitors the dagman.out file and generates a jobstate.log monitoring file. Additionally it label Mar 8, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Monitord Tailstatd monitors the dagman.out file and generates a jobstate.log monitoring file. Additionally it
Projects
None yet
Development

No branches or pull requests

1 participant