510 Commits
Author SHA1 Message Date
Ricardo Torres c148e647a7 Relocate Windows SDK and MSVC headers to host mount C:\sdk in Windows CI.
This resolves transient wcifs.sys sharing violations (b/556761966) during
highly parallel C++ compilation on Windows Kokoro runners by relocating
MSVC and Windows SDK include directories to a host-mounted directory.

PiperOrigin-RevId: 979506328
2026-09-10 18:31:29 -07:00
Daniel Sosa 449fef9d07 Reverts changelist 976362623
PiperOrigin-RevId: 976505695
2026-09-05 17:40:51 -07:00
TensorFlower Gardener 18889c3d93 Merge pull request #126677 from vishwakt:fix-tf2xla-empty-tensorlist-read
PiperOrigin-RevId: 976447081
2026-09-05 13:59:40 -07:00
TensorFlower Gardener 674373bfca Merge pull request #111739 from tensorflow:dependabot/pip/ci/official/requirements_updater/numpy1_requirements/markdown-3.8.1
PiperOrigin-RevId: 974581495
2026-09-01 10:55:43 -07:00
TensorFlower Gardener 404931198b Merge pull request #123786 from tensorflow:dependabot/pip/ci/official/requirements_updater/numpy1_requirements/setuptools-83.0.0
PiperOrigin-RevId: 973791443
2026-08-31 04:13:44 -07:00
A. Unique TensorFlower a33c850682 [NCCL] Upgrade XLA NCCL version to 2.30.7
PiperOrigin-RevId: 972462168
2026-08-28 04:05:14 -07:00
Dirk Hornung dac050e869 Add ml-build container for CUDA 12.1 and cuDNN 9.10 and modernize apt keyrings
1. Modernize setup.sources.sh:
   - Use HTTPS key downloads and scoped dearmored keys in /etc/apt/keyrings/ with [signed-by=...] in custom.list (replaces legacy apt-key keyserver lookup which timed out on port 11371).
   - Add set -euo pipefail for error safety.

2. Add CUDA 12.1 + cuDNN 9.10 container target:
   - Add cuda12.1_cudnn9.10.packages.txt pinning libcudnn9-*-cuda-12=9.10.2.21-1.
   - Add cuda12.1cudnn9.10 target and build step in build.sh.

PiperOrigin-RevId: 972026025
2026-08-27 10:35:24 -07:00
Vladimir Belitskiy 55da6197ef [CI] Remove obsolete Docker Linux images' package configuration files.
PiperOrigin-RevId: 971420817
2026-08-26 12:21:31 -07:00
Vladimir Belitskiy 84694de97e [ML CI - Docker] Refresh Python installation and modernize apt sources in ml_build container.
- Generalize Python version parsing using regex to extract base version and nogil/t suffixes.
- Add support for compiling pre-release Python versions (Python 3.15.0rc1) from source, including free-threaded builds (--disable-gil).
- Ensure clang-18 is installed when compiling pre-release Python versions from source.
- Update twine exclusion logic to dynamically target pre-release and free-threaded builds.
- Add get-pip.py URL fallback for Python 3.9.
- Add post-installation verification check to validate venv creation and pip bootstrapping.
- Update setup.sources.sh to fetch GPG keys over HTTPS into /etc/apt/keyrings and scope with signed-by, avoiding apt-key deprecation and HKP port 11371 flakiness.

PiperOrigin-RevId: 971257503
2026-08-26 08:48:45 -07:00
Dmitri Latushko c0f153e476 Fix toolchain configuration for windows_ltsc2022_clang_ml_actions to point to t20260812 LLVM 19 toolchain.
This updates .bazelrc, CI docker image digests, and deleted_packages for bazel query checks.

PiperOrigin-RevId: 970042564
2026-08-24 13:39:58 -07:00
Dirk Hornung 3090bdc31e Upgrade cuDNN version to 9.10.
This will bring Tensorflow's cuDNN version in sync to XLA's cuDNN version.

Note: Tensorflow uses CUDA 12.5 which is compatible to cuDNN 9.10 according to the offical support matrix https://docs.nvidia.com/deeplearning/cudnn/backend/v9.10.0/reference/support-matrix.html.
PiperOrigin-RevId: 969851689
2026-08-24 07:57:52 -07:00
dependabot[bot] 72763bfa86 Bump setuptools in /ci/official/requirements_updater/numpy1_requirements
Bumps [setuptools](https://github.com/pypa/setuptools) from 78.1.1 to 83.0.0.
- [Release notes](https://github.com/pypa/setuptools/releases)
- [Changelog](https://github.com/pypa/setuptools/blob/main/NEWS.rst)
- [Commits](https://github.com/pypa/setuptools/compare/v78.1.1...v83.0.0)

---
updated-dependencies:
- dependency-name: setuptools
  dependency-version: 83.0.0
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2026-08-11 06:10:28 +00:00
TensorFlower Gardener c9f30008eb Merge pull request #124063 from tensorflow:dependabot/pip/ci/official/requirements_updater/numpy1_requirements/requests-2.33.0
PiperOrigin-RevId: 962573866
2026-08-10 23:06:51 -07:00
David Dunleavy 799c993e33 Use canonical repo names for @grpc and @highway in XLA and TensorFlow
PiperOrigin-RevId: 962483618
2026-08-10 18:32:45 -07:00
Vladimir Belitskiy 791f94d6b6 [CI] Auto-detect Kokoro Docker clusters in setup.sh.
PiperOrigin-RevId: 960970819
2026-08-07 09:38:36 -07:00
dependabot[bot] 719c3f5141 Bump requests in /ci/official/requirements_updater/numpy1_requirements
Bumps [requests](https://github.com/psf/requests) from 2.32.4 to 2.33.0.
- [Release notes](https://github.com/psf/requests/releases)
- [Changelog](https://github.com/psf/requests/blob/main/HISTORY.md)
- [Commits](https://github.com/psf/requests/compare/v2.32.4...v2.33.0)

---
updated-dependencies:
- dependency-name: requests
  dependency-version: 2.33.0
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2026-08-05 10:09:44 +00:00
TensorFlower Gardener f3ba8c24ed Merge pull request #118918 from tensorflow:dependabot/pip/ci/official/requirements_updater/numpy1_requirements/idna-3.15
PiperOrigin-RevId: 959537300
2026-08-05 03:06:27 -07:00
A. Unique TensorFlower e697df8f61 Fix missing Python 3.14 in Windows nightly wheel build by installing on the fly
PiperOrigin-RevId: 957363257
2026-07-31 15:37:17 -07:00
TensorFlower Gardener fc7b135445 Merge pull request #118744 from ChiragSW:issue#118727
PiperOrigin-RevId: 955157902
2026-07-28 03:44:09 -07:00
TensorFlower Gardener dd60f9eb6e Merge pull request #123405 from tensorflow:dependabot/pip/ci/official/requirements_updater/numpy1_requirements/urllib3-2.7.0
PiperOrigin-RevId: 954501369
2026-07-27 02:42:49 -07:00
A. Unique TensorFlower 72731de3d7 Fix 3.14 nightly build, wheel verification failure on Windows CI.
PiperOrigin-RevId: 953740461
2026-07-24 23:22:10 -07:00
dependabot[bot] 49da681276 Bump urllib3 in /ci/official/requirements_updater/numpy1_requirements
Bumps [urllib3](https://github.com/urllib3/urllib3) from 2.6.3 to 2.7.0.
- [Release notes](https://github.com/urllib3/urllib3/releases)
- [Changelog](https://github.com/urllib3/urllib3/blob/main/CHANGES.rst)
- [Commits](https://github.com/urllib3/urllib3/compare/2.6.3...2.7.0)

---
updated-dependencies:
- dependency-name: urllib3
  dependency-version: 2.7.0
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2026-07-16 17:01:59 +00:00
A. Unique TensorFlower 06414c627f Update execution flow for the wheel upload
PiperOrigin-RevId: 948605211
2026-07-15 16:23:18 -07:00
Chirag Wattamwar a986f8dc6c Merge branch 'tensorflow:master' into issue#118727 2026-07-15 16:22:26 +05:30
A. Unique TensorFlower e2dab1985c Fix Python 3.14 multiprocessing spawn detection in multi_process_lib
PiperOrigin-RevId: 947214160
2026-07-13 13:35:34 -07:00
A. Unique TensorFlower f4231fa4e2 Change the order of the wheel upload
PiperOrigin-RevId: 947152090
2026-07-13 11:51:24 -07:00
A. Unique TensorFlower 4485388454 Point TF nightly wheel uploads to published GAR registry
PiperOrigin-RevId: 945218879
2026-07-09 13:06:31 -07:00
Vladimir Belitskiy 81809f4f76 Bump OpenJDK 21 -> 25.
PiperOrigin-RevId: 944701581
2026-07-08 14:33:54 -07:00
Antonio Sanchez 5c6a88e270 Add missing license headers.
PiperOrigin-RevId: 943541614
2026-07-06 16:07:27 -07:00
A. Unique TensorFlower 84ca25771f As part of migrating TensorFlow nightly wheel distribution off public PyPI to self-hosted Google Cloud Artifact Registry (GAR).
PiperOrigin-RevId: 943339083
2026-07-06 09:44:07 -07:00
Chirag 2d797d1706 lint formats 2026-07-03 01:25:47 +05:30
Chirag a6a294a463 solved dependency issue, added skip for negative vals, expanded unit test coverage, code cleaned on line 175 2026-07-02 23:04:04 +05:30
Chirag Wattamwar 596b5ed1ad Merge branch 'master' into issue#118727 2026-06-16 00:32:12 +05:30
A. Unique TensorFlower b35cc538b2 Automated: Migrate third_party/tensorflow/opensource_only/ci from gsutil to gcloud storage
This CL is part of the on going effort to migrate from the legacy `gsutil` tool to the new and improved `gcloud storage` command-line interface.
`gcloud storage` is the recommended and modern tool for interacting with Google Cloud Storage, offering better performance, unified authentication, and a more consistent command structure with other `gcloud` components. 🚀

PiperOrigin-RevId: 931910910
2026-06-14 01:26:34 -07:00
A. Unique TensorFlower f2c81e737a Squashing commits after sync tool breakage
Reverts changelist 931055902

PiperOrigin-RevId: 931213870
2026-06-12 10:48:38 -07:00
Chirag Wattamwarandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> 218fdf2838 Update ci/official/utilities/extract_resultstore_links.py
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2026-06-10 00:17:55 +05:30
Aditya Gupta 80b5139453 [ml-oss] Install GitHub CLI (gh) in ml-build Docker image
PiperOrigin-RevId: 926240716
2026-06-03 13:48:11 -07:00
Matthias Guenther bd94d9b162 Update ml-build Dockerfile to support StableHLO CI workflows
PiperOrigin-RevId: 922285402
2026-05-27 12:38:52 -07:00
Chirag 6912f653b1 replaced deprecation 2026-05-21 00:55:41 +05:30
dependabot[bot] bc760362eb Bump idna in /ci/official/requirements_updater/numpy1_requirements
Bumps [idna](https://github.com/kjd/idna) from 3.10 to 3.15.
- [Release notes](https://github.com/kjd/idna/releases)
- [Changelog](https://github.com/kjd/idna/blob/master/HISTORY.md)
- [Commits](https://github.com/kjd/idna/compare/v3.10...v3.15)

---
updated-dependencies:
- dependency-name: idna
  dependency-version: '3.15'
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2026-05-19 19:03:22 +00:00
Dmitri Latushko c0ef0f757e CUDA 13 Release build changes
PiperOrigin-RevId: 916141611
2026-05-15 13:40:40 -07:00
Dmitri Latushko 4a39b269e4 Add checksum verification for downloaded binaries in ml_build Dockerfile.
PiperOrigin-RevId: 915999981
2026-05-15 07:48:33 -07:00
A. Unique TensorFlower e07bd9dc88 Build: Upgrade base image packages
This updates base image packages to pull in security fixes.

PiperOrigin-RevId: 914486784
2026-05-12 15:00:08 -07:00
Dmitri Latushko 8d6a21df59 introducing Cuda13 build target
PiperOrigin-RevId: 912723972
2026-05-08 15:31:49 -07:00
Levon Ter-Grigoryan 48fe0368ff [NCCL] Upgrade XLA NCCL version to 2.29.7
PiperOrigin-RevId: 908006723
2026-04-30 00:55:11 -07:00
Quoc Truong fc47a7ebaf Add a container for CUDA 13.2 and CUDNN 9.15
PiperOrigin-RevId: 897878765
2026-04-10 14:18:43 -07:00
TensorFlower Gardener 583b449aaf Merge pull request #112004 from gurusai-voleti:ai-gsutil-migration-58a66265df20411896320ef6a2961b78
PiperOrigin-RevId: 897874131
2026-04-10 14:01:41 -07:00
Dmitri Latushko cd06d02996 GHA on windows: Add build profile uploading step
PiperOrigin-RevId: 896756687
2026-04-08 16:19:59 -07:00
dependabot[bot] 0c605c0101 Bump pygments in /ci/official/requirements_updater/numpy1_requirements
Bumps [pygments](https://github.com/pygments/pygments) from 2.19.1 to 2.20.0.
- [Release notes](https://github.com/pygments/pygments/releases)
- [Changelog](https://github.com/pygments/pygments/blob/master/CHANGES)
- [Commits](https://github.com/pygments/pygments/compare/2.19.1...2.20.0)

---
updated-dependencies:
- dependency-name: pygments
  dependency-version: 2.20.0
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2026-03-30 19:02:40 +00:00
Dmitri Latushko c114ce5461 Hosting builds for pull requests check on GitHub - Windows
PiperOrigin-RevId: 890778667
2026-03-27 21:33:01 -07:00