Support for caching and pipeline improvements for large Monorepo
Bitlife Life Simulator
Hello CircleCI team,
I am managing a large monorepo with many packages and services and have encountered some difficulties when running the pipeline:
Long build time: Currently, each commit must build almost the entire repository, even though it only changes a few small packages.
Unoptimized caching: The Current cache is sometimes not reusable between pipelines, leading to wasted time and resources.
Cross-dependency pipeline: It is difficult to manage individual workflows for each package when they have dependencies on each other.
I would like to propose some advanced features for monorepo:
Support incremental builds for each package/service instead of the entire repo.
Improve smart caching, recognize changes to each package and rebuild only the necessary parts.
Allow setting dependencies between Space Waves Game workflows for each package, helping the pipeline automatically run in the correct order without manual triggering.
Hopefully CircleCI can consider upgrading monorepo support to optimize performance and the CI/CD experience for large projects.
Thanks to the team that developed CircleCI!