Skip to content

fix: make GS Scorecard non-blocking for releases (#505) [sync develop to main]#519

Merged
mkolasinski-splunk merged 1 commit into
developfrom
main
Jul 17, 2026
Merged

fix: make GS Scorecard non-blocking for releases (#505) [sync develop to main]#519
mkolasinski-splunk merged 1 commit into
developfrom
main

Conversation

@mkolasinski-splunk

Copy link
Copy Markdown
Contributor

Summary

  • GS Scorecard tool remains available via execute_gs_scorecard label — developers can still use it
  • Scorecard results (pass/fail/missing) are now reported as ::warning:: instead of ::error:: and never cause the job to fail
  • Removed the pre-publish gate that blocked releases when scorecard was skipped on PRs to main
  • Fixes cases where scorecard flags checks as not checked, unintentionally blocking releases

https://github.com/splunk/splunk-add-on-for-cisco-esa/actions/runs/27544575031/job/81415137332?pr=480#step:9:268

🤖 Generated with Claude Code


Description

(PR description goes here)

Checklist

  • README.md has been updated or is not required
  • push trigger tests
  • manual release test
  • automated releases test
  • pull request trigger tests
  • schedule trigger tests
  • workflow errors/warnings reviewed and addressed

Testing done

(for each selected checkbox, the corresponding test results link should be listed here)

## Summary

- GS Scorecard tool remains available via `execute_gs_scorecard` label —
developers can still use it
- Scorecard results (pass/fail/missing) are now reported as
`::warning::` instead of `::error::` and never cause the job to fail
- Removed the `pre-publish` gate that blocked releases when scorecard
was skipped on PRs to main
- Fixes cases where scorecard flags checks as not checked,
unintentionally blocking releases


https://github.com/splunk/splunk-add-on-for-cisco-esa/actions/runs/27544575031/job/81415137332?pr=480#step:9:268

🤖 Generated with [Claude Code](https://claude.com/claude-code)

---------

Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
@mkolasinski-splunk
mkolasinski-splunk requested a review from a team as a code owner July 17, 2026 09:04

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: b20b7916ae

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment on lines +940 to +944
- name: Print GS Scorecard report
run: |
if [ ! -f ./gs_scorecard.json ]; then
echo "::error::GS Scorecard report not found"
exit 1
echo "::warning::GS Scorecard report not found"
exit 0

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P2 Badge Make the scorecard run step non-blocking too

In the run-gs-scorecard job, these warnings only run after the preceding Run GS Scorecard Docker step has succeeded. For any labeled PR or main push where the container exits non-zero (for example, if the tool reports failed checks via its process status), GitHub stops the job before this print step, so the workflow still ends with a failed quality-gs-scorecard job instead of the intended informational warning. Consider making the scorecard run continue on error and running the upload/print steps with always() if scorecard failures are meant to be non-blocking.

Useful? React with 👍 / 👎.

@rasteja

rasteja commented Jul 17, 2026

Copy link
Copy Markdown
Contributor

The comment near setup-workflow still says GS Scorecard is required for merges to main, but this PR removes that requirement. Please update or remove it so the documentation matches the non-blocking behavior.

@rasteja rasteja left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Approved.

@mkolasinski-splunk
mkolasinski-splunk merged commit 4bfdf05 into develop Jul 17, 2026
14 checks passed
@github-actions github-actions Bot locked and limited conversation to collaborators Jul 17, 2026
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants