aboutsummaryrefslogtreecommitdiffhomepage
path: root/.github
Commit message (Collapse)AuthorAge
* Use libClusterFuzz for CIFuzz fuzzing and pruning. (#6375)Gravatar Oliver Chang2021-09-13
| | | Part of #6326.
* [RawSpeed] Reenable errneously disabled MSan build (#6401)Gravatar Roman Lebedev2021-09-04
| | | | | | | I was not notified about that change, which i believe to be errneous. The fuzzers built here do *not* link to *any* outside libraries. Refs. https://github.com/google/oss-fuzz/pull/6281 Refs. https://github.com/google/oss-fuzz/issues/6294
* [cifuzz] Add basic end-to-end tests. (#6139)Gravatar jonathanmetzman2021-08-03
| | | | | | | This test doesn't really do diffing or affected fuzzers properly. Nor does it check the workspace for existence of certain things, nor does check the filesystem for proof things happened. It is still a WIP.
* [CI] Switch to google-github-actions/setup-gcloud (#5956)Gravatar jonathanmetzman2021-06-21
| | | GoogleCloudPlatform/github-actions/setup-gcloud is deprecated.
* ci: Fix get_changed_files_output (#5944)Gravatar MarcoFalke2021-06-21
| | | | | | | | | * ci: Fix get_changed_files_output * Update project_tests.yml * ci: Fix presubmit checks * ci: Use fetch-depth:0 instead of --unshallow
* Improve Actions hygiene (#5361)Gravatar Seth Vargo2021-03-10
| | | | | | | | | | | | | 👋 hello there! I'm a fellow Googler who works on projects that leverage GitHub Actions for CI/CD. Recently I noticed a large increase in our queue time, and I've tracked it down to the [limit of 180 concurrent jobs](https://docs.github.com/en/actions/reference/usage-limits-billing-and-administration) for an organization. To help be better citizens, I'm proposing changes across a few repositories that will reduce GitHub Actions hours and consumption. I hope these changes are reasonable and I'm happy to talk through them in more detail. - Only run GitHub Actions for pushes and PRs against the main branch of the repository. If your team uses a forking model, this change will not affect you. If your team pushes branches to the repository directly, this changes actions to only run against the primary branches or if you open a Pull Request against a primary branch. - For long-running jobs (especially tests), I added the "Cancel previous" workflow. This is very helpful to prevent a large queue backlog when you are doing rapid development and pushing multiple commits. Without this, GitHub Actions' default behavior is to run all actions on all commits. There are other changes you could make, depending on your project (but I'm not an expert): - If you have tests that should only run when a subset of code changes, consider gating your workflow to particular file paths. For example, we have some jobs that do Terraform linting, but [they only run when Terraform files are changed](https://github.com/google/exposure-notifications-verification-server/blob/c4f59fee71042cf668747e599e7c769fca736554/.github/workflows/terraform.yml#L3-L11). Hopefully these changes are not too controversial and also hopefully you can see how this would reduce actions consumption to be good citizens to fellow Googlers. If you have any questions, feel free to respond here or ping me on chat. Thank you!
* [infra] Improve test speed (#5118)Gravatar jonathanmetzman2021-02-05
| | | | | | | | | | | Make unittests take 20 seconds to run instead of 35. Make integration tests take 50 seconds to run instead of 6 minutes. Make CI take 6 minutes instead of 12 minutes. 1. Allow running tests in parallel. Locally this takes the time for running all tests (including integration tests) from 6 minutes to ~50 seconds. We don't do parallel by default since it doesn't really save any time unless running integration tests on my machine (probably due to overhead of starting ~70 processes). This also speeds up CI from about 12 minutes to 6 minutes (since github actions has 2 cores per machine). 2. Fix how we run tests. I'm not exactly sure why, but the method we used for discovering tests, recursing through every directory and passing to unittest caused the build/infra tests to execute twice. Fixing this makes running unittests take ~20 seconds instead of ~35. This change also uses pytest for running tests since it's easy to use it to run tests in parallel. This change was made possible by #5113
* Remove unnecessary stuffGravatar Jonathan Metzman2021-01-20
|
* Improve CIFuzz tests (#4868)Gravatar jonathanmetzman2020-12-18
| | | | | | | 1. Fix problem where permissions were being changed to root by non-root test (test was doing this by invoking test_all.py within docker). 2. Mark tests as integration tests so that cifuzz_test.py can be run in a reasonable amount of time. 3. Prevent some unittests from polluting source repo. 4. Add .venv to .gitignore 5. Rename test_test_all.py to the correctly formatted name "test_all_test.py"
* Revert msan patch (#4788)Gravatar Abhishek Arya2020-12-04
| | | | | | | | | * Revert "Fix msan build breakage. (#4787)" This reverts commit 8f4d1b237d55eeb6a098719f3602f89bd032b2b3. * Revert "Clean up MemorySanitizer library warnings (#4694)" This reverts commit 6fc050ec9ec29534ad079c83ef4bc2f709c083df.
* Clean up MemorySanitizer library warnings (#4694)Gravatar David Cook2020-12-03
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * Update infra/base-images/all.sh Add build of base-sanitizer-libs-builder and msan-libs-builder to this shell script. * msan: Don't warn on un-instrumented standard libs These libraries do not need to be built with instrumentation, because MemorySanitizer includes interceptors for them. * Fix indentation * Add missing docstrings * Fix unused variable * Fix invalid names * Install python-apt on CI * Revert "Install python-apt on CI" This reverts commit d3da49cf90f138674c1a8bcbdca2f0dfe6c385d1. * Install and use python-apt in system directory * Revert "Install and use python-apt in system directory" This reverts commit e0ede101fbdfbf82da5f32d0a206da247e6dde98. * Build python-apt from source * Check out correct version of python-apt * Fix octal literals * More indentation fixes * Add more missing docstrings * Change variable names of opened files * Remove unused import * Ignore lints about package.Package API * Fix or ignore remaining invalid names * Fix apparent typo in compiler_wrapper_test.py -z should precede a keyword, not a long option * Fix use of xrange * Style fixes, compiler_wrapper * Fix apparent error in compiler_wrapper_test.py Similar to the previous error, the test case would pass "-z --no-undefined" to the linker. "-z" only has an effect when it is followed by a keyword, otherwise ld ignores it and prints a warning message. In this test case, "-z" and "--no-undefined" were passed in two separate "-Wl," compiler arguments, but they reflect a common issue. * Add missing license header * Rename more functions * Better name for global variable * Rename methods of Package * Rename functions in msan_builder.py * Fix invalid variable names * Fix useless-object-inheritance * pylint: Fixes for Package and its subclasses * Remove unused imports * Indentation fixes * Fix too-may-locals error in msan_build.py * Add missing docstrings
* Fix permission denied errors on CI in unittests (#4664)Gravatar jonathanmetzman2020-11-20
| | | Also remove usrstcp from the repos we do tests since they no longer work with usrstcp (repo history seems to have been rewritten).
* CI fix. (#4139)Gravatar Abhishek Arya2020-07-15
|
* Missing hyphen (#4106)Gravatar kabeer272020-07-10
| | | | | | | | | | | | | * Missing hyphen * Testing infra-tests * Testing ingra-tests * Testing infra-tests * Undoing license header changes Co-authored-by: Kabeer Seth <kabeerseth@google.com>
* Test fix pip installs (#4099)Gravatar kabeer272020-07-09
|
* Renaming infra/build/functions files (#4031)Gravatar kabeer272020-06-29
| | | | | | Renamed main.py to sync.py and test_sync.py to sync_test.py Co-authored-by: Kabeer Seth <kabeerseth@google.com>
* [util-linux] cover mnt_table_parse_stream (#4032)Gravatar Evgeny Vereshchagin2020-06-25
| | | | | | | | | * [util-linux] cover mnt_table_parse_stream Waiting for https://github.com/karelzak/util-linux/pull/1068 * temporarily point OSS-Fuzz to evverx/util-linux * make sure it can be built with sanitizer=coverage
* Cloud function for syncing OSS-Fuzz projects (#3538). (#4023)Gravatar kabeer272020-06-25
| | | | | Integrating the first cloud function i implemented which syncs the project list from github and uploads the list to cloud datastore, which will be used by another cloud function to request builds. Co-authored-by: Kabeer Seth <kabeerseth@google.com>
* Add Github Actions CI. (#3971)Gravatar Abhishek Arya2020-06-12