Policy Log Parser

[seansb]

Hello All!

Like a few others, we have a business need to report on the success or failure of certain policies. I've seen several feature requests asking JAMF to create the ability to export Policy Log results in a CSV or PDF format, but it doesn't look like that feature has been implemented.

Due to our need - I've created a way to parse the HTML of the Policy Log page so that we can grab the pertinent information and write it to a CSV file. This is just a first pass but I wanted to throw it out there to get some ideas flowing and with any luck, help out a few other JAMFNationers. It's honestly pretty jenky but it seems to work (for me anyway).

I'm not great with screen scraping and failed miserably at trying to directly go out parse the page straight from JSS... so

Here's my process:

1. Pull up whichever policy you want to report on in your JSS. Click on the Logs to view the Policy Logs.
2. Make sure that you view options are set to view ALL entries / results from the policy
3. Right click anywhere on the website and save the page to your machine. I save the complete webpage
4. Run my script and enter in the name of the HTML you saved. E.X. ( sh policy_parser.sh ~/Downloads/mypolicy.html)

a CSV file will be generated and placed into your /Users/Shared directory called policy_report-<date>.csv

A summary will be placed at the end of the CSV with how many successes, failures, and pending there are.

I hope this helps some of you out there!

#!/bin/bash

##########################################################################################
#
# Author: Sean Burke
# Date: 5-27-2015
# Purpose:  Script to parse Policy Logs to create a CSV Summary
#
##########################################################################################


##################
##  VARIABLES  ### 
##################

# Take in Parameter 1 as the HTML file to parse
inputHTML=$1

newEntry=""

successful=0
pending=0
failed=0

machineName=""
userName=""
policyTime=""
policyStatus=""

# Output File Information
currentDate=`date +"%m_%d_%y"`
reportOutput="/Users/Shared/policy_report-$currentDate.csv"

# Process the HTML file and parse for the section that contains all the computer and status info
htmlResult=`cat "$inputHTML" | sed -n "/<tbody/,/</tbody>/p"`

######################
##  END VARIABLES  ### 
######################


# Read in HTML format
read_dom () {
    local IFS=>
    read -d < ENTITY CONTENT
}


# Write headers to the CSV File
echo "Machine Name, User, Policy Status, Policy Time" >> "$reportOutput"

# Write to CSV File with contents
write_line()
{
    echo "$1, $2, $3, $4" >> "$reportOutput"
}

numProcessed=0
while read_dom; do

    CONTENT=`echo $CONTENT | sed 's/^ *//'`

    # TBODY contains all the computer info we need
    if [[ "$ENTITY" == *"tbody"* ]]
    then
        newEntry="properSection"
    fi

    # Looks for the specific TBODY section which contains 
    if [ "$newEntry" ]
    then
        # a href is the link to the computer object, which marks a new entry to process     
        if [[ "$ENTITY" == *"a href"* ]]
        then
            ((numProcessed++))
            echo "---- START COMPUTER ----
"
            # Remove any commas or quotes which may throw off the CSV writing
            machineName=`echo "$CONTENT" | sed 's/,/''/g' | sed 's/"//g'`
            # Re-Set the other variables to blank, in case they are actually blank for the new record
            userName=""
            policyTime=""
            policyStatus=""
            echo "Content: $CONTENT"
        fi

        if [[ "$ENTITY" == *"td"* ]]
        then
            if [ "$CONTENT" ]
            then
                # Process the Status of the Machine
                if [[ "$CONTENT" == *"Pending" ]] || [[ "$CONTENT" == *"Completed" ]] || [[ "$CONTENT" == *"Failed"* ]]
                then 
                    if [[ "$CONTENT" == *"Pending"* ]]
                    then
                        ((pending++))
                    elif [[ "$CONTENT" == *"Completed"* ]]
                    then
                        ((successful++))
                    else
                        ((failed++))
                    fi              
                    policyStatus="$CONTENT"
                    echo "Content: $CONTENT"
                    echo "---- END COMPUTER ----
"
                    write_line "$machineName" "$userName" "$policyStatus" "$policyTime"
                    echo "Num Processed: $numProcessed"
                else
                    # If the entry contains the word at, we know it's talking about a policy time entry
                    if [[ "$CONTENT" == *"at"* ]]
                    then
                        echo "Policy Time: $CONTENT"
                        policyTime="$CONTENT"
                    else
                        userName="$CONTENT"
                    fi
                fi
            fi
        fi
    fi  
done <<< "$htmlResult"

write_line "" "" "" ""
write_line "" "" "" ""

write_line "Num Success: $successful"
write_line "Num Pending: $pending"
write_line "Num Failed: $failed"

[CAJensen01]

Can you amend this to include policy logs?

[sparker]

Thank you for the log parsing script! This came in handy today.