Skip to content

Fix DSLite tests and add to github actions CI - #728

Open
timcadman wants to merge 13 commits into
v7.0-devfrom
test/dslite-harness
Open

timcadman wants to merge 13 commits into
v7.0-devfrom
test/dslite-harness

Conversation

@timcadman

@timcadman timcadman commented Oct 29, 2026 •

Copy link
Copy Markdown
Contributor

Issue

Previously CI didn't run DSLite, which meant some of the changes on v7.0-dev worked on real servers but not on DSLite. Cost to run on CI is small because it is very quick.

What's changed

  • Broadened message assertion regex where DSLite was returning different message (alternative would be upstream change to dslite but this seeemed easier/lazier)
  • Put in some if clauses where dslite has different behaviour
  • Supressed warnings - this was causing some very long tests

@github-actions

github-actions Bot commented Oct 29, 2026 •

Copy link
Copy Markdown
⏳ 4 of 5 checks reported so far
CheckResult
Devtools checks✅ passed
Code quality✅ 0 new findings (package total: 1926)
Armadillo unit tests✅ [ FAIL 0 | WARN 0 | SKIP 21 | PASS 11809 ]
Opal unit tests✅ [ FAIL 0 | WARN 0 | SKIP 21 | PASS 11417 ]
Test coverageℹ️ no coverable lines changed (project: 67.9%)

Tested against dsBase versions:
Armadillo: 7.0.0.9000
Opal: 7.0.0.9000

Logs: Devtools checks · Code quality · Armadillo unit tests · Opal unit tests · Codecov

Comment thread tests/testthat/setup.R Fixed
@codecov-commenter

codecov-commenter commented Oct 29, 2026 •

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 67.88%. Comparing base (b88f471) to head (2428f57).

Additional details and impacted files
@@              Coverage Diff              @@
##           v7.0-dev     #728       +/-   ##
=============================================
+ Coverage     47.55%   67.88%   +20.33%     
=============================================
  Files           131      131               
  Lines          5076     5076               
=============================================
+ Hits           2414     3446     +1032     
+ Misses         2662     1630     -1032     
Flag Coverage Δ
armadillo-arg 20.58% <ø> (ø)
armadillo-misc 17.84% <ø> (ø)
armadillo-perf-1 10.59% <ø> (ø)
armadillo-perf-2 19.30% <ø> (ø)
armadillo-perf-3 18.42% <ø> (?)
armadillo-smk-1 41.68% <ø> (?)
armadillo-smk-2 35.99% <ø> (?)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@timcadman timcadman changed the title Test/dslite harness Fix DSLite tests and add to github actions CI Oct 30, 2026
@timcadman
timcadman force-pushed the test/dslite-harness branch from da10789 to 06eca4c Compare October 30, 2026 12:30
Comment thread tests/testthat/setup.R Fixed
Comment thread tests/testthat/setup.R Fixed
@timcadman
timcadman marked this pull request as ready for review October 30, 2026 19:23
@StuartWheater

Copy link
Copy Markdown
Member

A run time of 2h2m26s is a lot longer than I would expect with DSLite

@StuartWheater StuartWheater left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Has the error message checking been aligned with DSLite, Armadillo and Opal?

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Development

Successfully merging this pull request may close these issues.

4 participants