Skip to content

Turn on testForkGrouping by default #4419

Closed

Description

@lihaoyi

Small projects probably won't notice the slight increase in overhead with testForkGrouping enabled, while larger projects would benefit substantially from the parallelism. And people can turn it off if necessary.

Mill's been using it since 0.12.0 and it's been pretty robust, probably can make it the default in 0.13.0

Activity

  1. lefou commented on Jan 28, 2025

    @lefou
    Member

    In my larger projects, testForkGrouping increased test time significantly. This is most likely project and hardware specific but I have yet to find the project where this setting results in relevant faster tests on my hardware.

  2. lihaoyi commented on Jan 28, 2025

    @lihaoyi
    MemberAuthor

    I think it depends on how big your test suite classes are and how long they take to run. If your classes are numerous and fast, then the overhead of spawning JVMs for each one dominates. If they are few and slow, then the overhead is small and the parallelization benefits win out

  3. lefou commented on Jan 28, 2025

    @lefou
    Member

    It looks to me this should be a runtime setting rather than build script defined, since it may vary for user / machine / use-case and also ideally should not affect any built outcome.

  4. lihaoyi commented on Mar 14, 2025

    @lihaoyi
    MemberAuthor

    The new setting def testParallelism is on by default in main. At least in the tests I did it seems to be self-tuning enough to work well for both slow and fast test suites, so hopefully having it on will be a reasonable default

  5. added this to the 0.13.0 milestone on Mar 14, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions