aboutsummaryrefslogtreecommitdiffhomepage
path: root/infra
Commit message (Collapse)AuthorAge
* [base-clang] Change OUR_LLVM_REVISION (#6970)Gravatar MarcoFalke2021-12-06
| | | | | * [base-clang] Change OUR_LLVM_REVISION * llvmorg-14-init-8033-gabb2a91b
* [base-clang] Use llvmorg-14-init-8564-g34b903d8 (#6961)Gravatar jonathanmetzman2021-12-03
| | | | Use clang version before this change: https://chromium-review.googlesource.com/c/chromium/src/+/3310960 Fixes: #6957
* [cifuzz] Copy repo from image before checking out. (#6941)Gravatar jonathanmetzman2021-12-01
| | | | | | | | | | | | * [cifuzz] Copy repo from image before checking out. Do this instead of cloning repo anew. Fixes: https://github.com/google/oss-fuzz/issues/6755 * fix tests * Add test code for cifuzz-example * fix
* update afl++ commit id (#6936)Gravatar van Hauser2021-11-30
| | | | * update afl++ commit id
* Allow for easy reproducable builds with afl++ (#6889)Gravatar van Hauser2021-11-30
| | | | | | | | | | | * update afl++ commit id * update afl++ commit id * fix for afl++ * attempt fix for curl * allow easy reproducable afl++ builds
* [java][coverage] Make sure filenames is a string and not a list. (#6928)Gravatar jonathanmetzman2021-11-30
| | | | | | | | | * single quotes * [java][coverage] Make sure filenames is a string and not a list. Fixes: https://github.com/google/oss-fuzz/issues/6913 * fmt
* attempted fix for curl (#6882)Gravatar van Hauser2021-11-22
| | | | | | | | | * update afl++ commit id * update afl++ commit id * fix for afl++ * attempt fix for curl
* fix afl++ issue (#6866)Gravatar van Hauser2021-11-19
| | | | | | | * update afl++ commit id * update afl++ commit id * fix for afl++
* fix for afl++ (#6843)Gravatar van Hauser2021-11-17
| | | | | * update afl++ commit id * update afl++ commit id
* Employ cloudbuild for build status (#6767)Gravatar Navidem2021-11-17
| | | This resolves #5968 by employing cloud build to run update_build_status.py
* infra: Remove redundant --cap-add SYS_PTRACE (#6808)Gravatar MarcoFalke2021-11-15
| | | | | * infra: Remove redundant --cap-add SYS_PTRACE * format?
* update afl++ commit id (#6809)Gravatar van Hauser2021-11-11
|
* [ClusterFuzzLite] Fix fuzz target search for coverage (#6799)Gravatar jonathanmetzman2021-11-09
| | | | | | | Coverage uses a different mechanism for determining if a file is a fuzz target: It considers any executables in the top level of /out as fuzz targets. Fixes #6768
* Make gsutil the default filestore on GCB. (#6771)Gravatar jonathanmetzman2021-11-05
| | | Also clean up https://github.com/google/oss-fuzz/pull/6744
* Remove stack_parser. (#6763)Gravatar Oliver Chang2021-11-04
| | | Fixes #6762.
* [cfl] Temporary fix for testcase_path in reproduce. (#6760)Gravatar jonathanmetzman2021-11-04
| | | See: https://github.com/google/oss-fuzz/issues/6758
* Write project.yaml for external generator. (#6764)Gravatar Oliver Chang2021-11-04
|
* fix Dockerfile COPY command (#6757)Gravatar Navidem2021-11-03
|
* Don't check for novel crash in batch fuzzing. (#6749)Gravatar Oliver Chang2021-11-03
| | | | | * Don't check for novel crash in batch fuzzing. * format
* Use nargs='*' instead of REMAINDER for helper.py. (#6750)Gravatar Oliver Chang2021-11-03
| | | | | | argparse.REMAINDER is too greedy and will consume known optional arguments as well. Fixes #6686.
* Don't set seed for batch fuzzing. (#6736)Gravatar Oliver Chang2021-11-03
| | | Fixes #6714.
* Add DOCKER_IN_DOCKER and filestore to platform config (#6744)Gravatar Mitchel Herman2021-11-03
| | | Do this to reduce configuration required for GCB and Prow.
* Add Prow PlatformConfig (#6732)Gravatar Mitchel Herman2021-11-02
|
* [clusterfuzzlite] Make timeout and OOM reporting optional. (#6711)Gravatar jonathanmetzman2021-11-02
| | | | | | | OOMs will be reported by default. Timeouts wont. Fixes: https://github.com/google/oss-fuzz/issues/6703 Should also fix: https://github.com/google/oss-fuzz/issues/6619 Fixes: https://github.com/google/oss-fuzz/issues/3432 Related: https://github.com/google/oss-fuzz/issues/6685
* CFLite: Logging fixes. (#6715)Gravatar Oliver Chang2021-11-02
| | | | | Don't output stacktrace again in detected bug log message. Disable Python buffering to avoid log interleaving issues.
* Fix typo (#6731)Gravatar jonathanmetzman2021-11-01
|
* Fix pushing clusterfuzzlite-build-fuzzers (#6730)Gravatar jonathanmetzman2021-11-01
|
* Make a better api for platform specific config. (#6708)Gravatar jonathanmetzman2021-11-01
| | | | | | 1. Move most of the generic stuff into BasePlatformConfig. 2. Make a GCB platform config that sets WORKSPACE and PROJECT_SRC_PATH so users don't have to. 3. Make a skeleton prow platform_config for Mitchel to fill out. 4. Make users explicitly specify the CFL_PLATFORM so we can pick CI environments
* Abstract away duplicate code in prepare_for_fuzzer_build (#6706)Gravatar jonathanmetzman2021-11-01
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | Share more code between the 4 implementations of `prepare_for_fuzzer_build`. This simplifies the code of these implementations, reduces repetition and makes them easier to understand. Create helper functions/methods for: 1. Creating a failed `BuildPreparationResult`: `get_build_preparation_failure` 2. Building an external project docker image: `_build_external_project_docker_image` 3. Cloning a repo and checking out the specified commit/pr: `_clone_repo_and_checkout` 4. Detecting the main repo `_detect_main_repo` 5. Creating a repo manager from an existing checkout: `_create_repo_manager_for_project_src_path` Change `ExternalGeneric` implementation of `prepare_for_fuzzer_build` to: 1. Call `_create_repo_manager_for_project_src_path` 2. Call `_build_external_project_docker_image` Change `InternalGeneric` implementation of `prepare_for_fuzzer_build` to: 1. Call `_detect_main_repo` 2. Call `_create_repo_manager_for_project_src_path` Change `ExternalGithub` implementation of `prepare_for_fuzzer_build` to: 1. Call `_clone_repo_and_checkout` 2. Call `_build_external_project_docker_image` Change `InternalGithub` implementation of `prepare_for_fuzzer_build` to: 1. Call `_detect_main_repo` 2. Call `_clone_repo_and_checkout`
* Fix diffing on non-GitHub and improve config (#6707)Gravatar jonathanmetzman2021-10-31
| | | | | | | | | | | | | | | | | | | Fix diffing on non-GitHub and improve config 1. Remove obsolete comments. 2. Remove unused function get_pr_ref 3. Correct comment on git_sha 4. Rename commit_sha to git_sha 5. Make base_commit, pr_ref, and base_ref non-github specific and move to CiEnvironment. 6. Hoist get_diff_base to base class to allow diffing 7. Fix downloading coverage on non-Github. 8. Add TODO so that we don't assume github actions is run on github.com (enterprise users) 9. Rename repo_url to git_url. 10. Add missing git_url method base class. 11. Clarify what git_url, git_sha and pr_ref are for and leave TODOs about how we can eliminate them. 12. Fix typos.
* [clusterfuzzlite] Upload builds after doing bad build check (#6712)Gravatar jonathanmetzman2021-11-01
| | | | Builds shouldn't be uploaded if the check fails. Fixes: https://github.com/google/oss-fuzz/issues/6667
* [build-images.sh] Improve testing (#6709)Gravatar jonathanmetzman2021-10-31
|
* Fix download_latest_build for pull requests. (#6688)Gravatar Oliver Chang2021-10-29
| | | | | | | | | | | | Getting the LATEST_BUILD_WINDOW latest commits from HEAD^ is wrong. We should use the diff base instead. Also modify the Ci.get_diff_base methods to not include "..." in the return value. This will be appended in get_changed_code_under_test instead. This also potentially fixes a behaviour mismatch with GitHub PRs and diffing against the latest base branch rather than git merge-base base-branch HEAD.
* [clusterfuzzlite] Fixes for gsutil (#6683)Gravatar jonathanmetzman2021-10-28
| | | | | 1 Fix usage of gsutil tool. 2 Get rid of run_fuzzers_mode and change to mode. Fixes: #6677 3 Install requirements before copying source code to make iterative development of cifuzz code faster.
* [clusterfuzzlite] Don't use cifuzz term in image name (#6661)Gravatar jonathanmetzman2021-10-28
| | | | Make images that dont reference cifuzz but which reference clusterfuzzlite instead.
* Use shutil.copytree instead of dir_util.copy_tree. (#6673)Gravatar Oliver Chang2021-10-28
| | | | We can use shutil.copytree's dirs_exist_ok now that we have a new Python.
* [ClusterFuzzLite] Support GCB and gsutil/gcs as filestore. (#6629)Gravatar jonathanmetzman2021-10-27
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * add gsutil filestore * lint * Fix * Add build image script * get gcb fuzzing working * fmt and fix config_utils_test * Check that crashes are uploaded * Add no_filestore * fix test * fix tests * fix * Print crash URL * Fix * fix * fmt * lnt * fix * fmt
* Upload crash artifacts per target by its name. (#6660)Gravatar Oliver Chang2021-10-27
| | | Rather than always upload to the "current" artifact.
* cifuzz: Fix artifacts uploading issues. (#6646)Gravatar Oliver Chang2021-10-27
|
* cifuzz: set log level to info by default. (#6604)Gravatar Oliver Chang2021-10-26
| | | | | | | | | | Also fix some logging issues: - Don't output every single stacktrace when determining if a crash is reproducible. It outputs too many things into the logs and makes it hard to read. - Log OSS-Fuzz corpus path - Fix a minor typo and an error log with deleting the xenial image.
* Fix builds after Jazzer breaking change (#6622)Gravatar Fabian Meumertzheim2021-10-20
| | | | Follow-up to f043a72a0e632455f9939383efd60c131973c570, which became necessary due to https://github.com/CodeIntelligenceTesting/jazzer/commit/24069c388579f54ec9872e61efa44f5e6065f838
* cifuzz: Rename run-fuzzers-mode to mode. (#6600)Gravatar Oliver Chang2021-10-20
| | | | | Also change the default value of "ci" to the more consistent and descriptive "code-change".
* cflite: Support private repos (#6592)Gravatar Oliver Chang2021-10-20
| | | | | Pass github token during cloning. Fixes #6584
* Get repository URL from environment variable instead. (#6582)Gravatar Oliver Chang2021-10-20
| | | | | | | | | * Get repository URL from environment variable instead. Fixes #6576. * fix lint * use https instead
* rust coverage: broader definition for remaps (#6595)Gravatar Catena cyber2021-10-19
| | | As shown by opensk, rust files can be in a deeper directory
* profraw: fix python uint64 for difference (#6603)Gravatar Catena cyber2021-10-14
| | | And use right column for section address
* profraw: bump up version to 8 (#6594)Gravatar Catena cyber2021-10-13
| | | | | | | * profraw: bump up version to 8 following https://reviews.llvm.org/D111123 * fixup format
* [selinux] also pass --no-install-recommends to apt-get (#6586)Gravatar Evgeny Vereshchagin2021-10-12
| | | | | | | | | | | | | | | | | | | | * [selinux] also pass --no-install-recommends to apt-get This should help to speed up that step a little. Suggested by Christian Göttsche in https://github.com/SELinuxProject/selinux/pull/316#issuecomment-941011066 * [selinux] no longer install xmlto xmlto is used to build the secilc manpages so it isn't necessary to install it here. Suggested by @doverride in https://github.com/SELinuxProject/selinux/pulls#issuecomment-941047449 * This partly reverts 0c5679cd24e5e6130a8 The part where the fuzz targets were added is intact. It should address https://github.com/google/oss-fuzz/issues/6585
* profraw_update: chmod +x (#6587)Gravatar Catena cyber2021-10-12
|
* Run multiple jobs/workers by setting env vars (#5924)Gravatar Federico Maggi2021-10-11
| | | | | | | | | | | | | | * Run multiple jobs/workers by setting env vars ```bash $ infra/base-images/all.sh $ python3 infra/helper.py run_fuzzer -e N_JOBS=4 -e N_WORKERS=4 --engine $ENGINE $PROJECT_NAME $FUZZ_TARGET ``` * Switched from N_JOBS/WORKERS to FUZZER_EXTRA_ARGS * Added hashicorp/hcl/hclsyntax fuzzers * Getting rid of FUZZER_EXTRA_ARGS