Skip to content

Commit

Permalink
ci: 👷 add step times to CI summary (#46)
Browse files Browse the repository at this point in the history
Co-authored-by: David Gasquez <davidgasquez@gmail.com>
  • Loading branch information
DistributedDoge and davidgasquez authored Jan 15, 2024
1 parent a135ed8 commit 72d51cf
Showing 1 changed file with 17 additions and 1 deletion.
18 changes: 17 additions & 1 deletion .github/workflows/ci.yml
Original file line number Diff line number Diff line change
Expand Up @@ -26,10 +26,24 @@ jobs:
- name: Run
run: |
make run
set -o pipefail
make run 2>&1 | tee dagster.log
env:
COVALENT_API_KEY: ${{ secrets.COVALENT_API_KEY }}

- name: Extract Step Execution time from logs
run: |
echo "Dagster step timings:" >> $GITHUB_STEP_SUMMARY
echo "Step Name | Execution Time" >> $GITHUB_STEP_SUMMARY
echo "-----------|----------------" >> $GITHUB_STEP_SUMMARY
while IFS= read -r line; do
if [[ $line == *"STEP_SUCCESS"* ]]; then
step_name=$(echo "$line" | awk -F' - ' '{print $7}')
exec_time=$(echo "$line" | awk -F' - ' '{split($9,a," "); print a[7]}')
echo "$step_name | $exec_time" >> $GITHUB_STEP_SUMMARY
fi
done < dagster.log
- name: Export Database and Log File Sizes
run: |
make tables
Expand All @@ -40,8 +54,10 @@ jobs:
ls -lh data/tables | tail -n +2 | awk '{printf "| %s | %s |\n", $9, $5}'
} >> $GITHUB_STEP_SUMMARY
ls -lh data/tables
- name: Install Quarto
uses: quarto-dev/quarto-actions/setup@v2

- name: Render
run: |
make render

0 comments on commit 72d51cf

Please sign in to comment.