zzos/tensorflow
1
0
Fork 0
mirror of https://github.com/tensorflow/tensorflow.git synced 2026-09-28 05:13:36 +08:00
Code Issues Packages Projects Releases Wiki Activity
199,467 Commits 2,622 Branches 227 Tags
master
Commit Graph
510 Commits
Author SHA1 Message Date
Raviteja Gorijala a8594bfd70 Loop through bazel --version to download bazel before executing its commands. 
PiperOrigin-RevId: 693486881
 2024-11-05 15:07:55 -08:00
Quoc Truong dd11e56214 Add infrastructure-public-image- tags to ML build containers. This is to comply with public image lifecycle management. 
PiperOrigin-RevId: 693412716
 2024-11-05 11:23:30 -08:00
TensorFlower Gardener 8b5b401f61 Merge pull request #78883 from tensorflow:dependabot/pip/ci/official/requirements_updater/numpy1_requirements/werkzeug-3.0.6 
PiperOrigin-RevId: 693225385
 2024-11-05 00:28:15 -08:00
TensorFlower Gardener 3c4042cf12 Merge pull request #79197 from tensorflow:dependabot/docker/ci/official/containers/linux_arm64/ubuntu-8e5c4f0 
PiperOrigin-RevId: 693224985
 2024-11-05 00:20:07 -08:00
Quoc Truong ba0d9ec99e Change TPU nightly build to use the new ML build container. 
PiperOrigin-RevId: 693224473
 2024-11-05 00:00:04 -08:00
dependabot[bot] 9db53e8746 Bump ubuntu in /ci/official/containers/linux_arm64 
Bumps ubuntu from `fa17826` to `8e5c4f0`.

---
updated-dependencies:
- dependency-name: ubuntu
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-11-01 08:30:33 +00:00
Quoc Truong 48fc96ab3e Install python3.12 last as the default version. Add a TODO so we can switch to pyenv eventually. 
PiperOrigin-RevId: 691209903
 2024-10-29 17:07:17 -07:00
Quoc Truong 8d6f53d039 Change to new ML container for presubmit build. There was a merge conflict that didn't change the container build in the previous CL. 
PiperOrigin-RevId: 690673264
 2024-10-28 10:57:41 -07:00
dependabot[bot] c42e8f079d Bump werkzeug in /ci/official/requirements_updater/numpy1_requirements 
Bumps [werkzeug](https://github.com/pallets/werkzeug) from 3.0.3 to 3.0.6.
- [Release notes](https://github.com/pallets/werkzeug/releases)
- [Changelog](https://github.com/pallets/werkzeug/blob/main/CHANGES.rst)
- [Commits](https://github.com/pallets/werkzeug/compare/3.0.3...3.0.6)

---
updated-dependencies:
- dependency-name: werkzeug
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-10-28 14:33:43 +00:00
A. Unique TensorFlower 14fe7ddb7d Add TF wheel API Bazel test for Linux and MacOS platforms. 
PiperOrigin-RevId: 689025141
 2024-10-23 11:48:35 -07:00
Quoc Truong 34d11b1018 Add python3.13 to new ML Build Container Dockerfile. Modify the installation order so python3.12 will be the default. 
PiperOrigin-RevId: 686679575
 2024-10-16 16:34:34 -07:00
Quoc Truong 2869a11f84 Migrate presubmit job Linux x86 jobs to use the new ML build container cluster. The continuous and nightly job will be migrated next. Once all the jobs are migrated, the new linux_x86_build file will be removed and the old linux_x86 env file will have its container replaced. 
PiperOrigin-RevId: 686155012
 2024-10-15 10:46:22 -07:00
A. Unique TensorFlower 16692e241e Add building TF wheel to Linux and MacOS presubmit jobs. 
Refactor shell scripts: replace `TF_PYTHON_VERSION` with `HERMETIC_PYTHON_VERSION`.

PiperOrigin-RevId: 685867155
 2024-10-14 16:45:36 -07:00
Quoc Truong 1d6a137a4b Add vim to the ML Build Docker container. 
PiperOrigin-RevId: 684978227
 2024-10-11 15:54:10 -07:00
A. Unique TensorFlower aabdfd743d Add requirements for running TF wheel API test with Numpy 1.x.x build. 
PiperOrigin-RevId: 684975835
 2024-10-11 15:42:53 -07:00
Quoc Truong 91c64d1791 Install python 3.13 to the new ML build Docker Container. 
PiperOrigin-RevId: 684623709
 2024-10-10 17:37:46 -07:00
A. Unique TensorFlower 7ba00ec863 Fix import_api_packages_test for the cases when WHEEL_NAME is passed to Bazel options. 
Add `--@xla//xla/tsl:wheel_dependency=true` flag to wheel tests.

PiperOrigin-RevId: 684610277
 2024-10-10 16:22:54 -07:00
A. Unique TensorFlower b3e39cf276 Add Python 3.13.0 to JAX Docker images with CUDA 12.3 and CUDA 12.1. 
Set max Python version to 3.13.0 in JAX Kokoro jobs.

PiperOrigin-RevId: 684216757
 2024-10-09 16:55:37 -07:00
David Dunleavy 7305a9df49 Install GNU Parallel in docker containers 
PiperOrigin-RevId: 684125400
 2024-10-09 12:53:03 -07:00
Quoc Truong 8df9913559 Add build python module to ML build container. This is needed to build JAX. 
PiperOrigin-RevId: 683811243
 2024-10-08 17:20:23 -07:00
A. Unique TensorFlower 98e7b330a1 Internal change 
PiperOrigin-RevId: 682405282
 2024-10-04 19:25:48 +00:00
Quoc Truong c73d62e85e Add Python packages for wheel uploading and manylinux verifications. 
PiperOrigin-RevId: 682023006
 2024-10-03 14:13:05 -07:00
TensorFlower Gardener 698e70e1c6 Merge pull request #74090 from apraga:no-distutil 
PiperOrigin-RevId: 681589525
 2024-10-02 15:16:02 -07:00
Kanglan Tang cbb605fed1 Update TF CI scripts for NumPy 1 
PiperOrigin-RevId: 681565583
 2024-10-02 14:18:17 -07:00
Raviteja Gorijala e551a7b9ab Update tb-nightly to 2.19.0a and keras-nightly >= 3.6.0.dev 
PiperOrigin-RevId: 681101860
 2024-10-01 11:46:13 -07:00
Mihai Maruseac 52909d48fe Merge branch 'master' into no-distutil 2024-10-01 05:56:16 -07:00
Quoc Truong a4d33071d5 Grant executable permission to bash script file. 
PiperOrigin-RevId: 678448479
 2024-09-24 17:09:28 -07:00
Kanglan Tang c46888a695 Update support for NumPy 2.1 
Note that NumPy 2.1 does not support Python 3.9 https://numpy.org/doc/stable/release/2.1.0-notes.html#numpy-2-1-0-release-notes

PiperOrigin-RevId: 678391800
 2024-09-24 14:41:01 -07:00
Quoc Truong d2933c4aed Add new Docker Container image now that we have hermetic CUDA and hermetic Python. The new Docker Container image is still a WIP and will be based on the existing one in tensorflow-sigs. The image size is reduced from 5.8GB to 1.8GB. 
PiperOrigin-RevId: 678375199
 2024-09-24 13:45:58 -07:00
A. Unique TensorFlower 55ca3b150c Add TF wheel API test. 
This test verifies whether the API v2 packages can be imported from the
current build. It utilizes the `_api/v2/api_packages.txt` list of packages from
the local wheel file specified in the `requirements_lock_<python_version>.txt`.

The test should be executed after the TF wheel was built and put into `dist` dir inside Tensorflow repository.

PiperOrigin-RevId: 676893008
 2024-09-20 10:43:17 -07:00
Kanglan Tang 0b1c40d424 [Numpy] Upgrade TF wheels to NumPy 2.0 
To ensure compatibility with numpy>=2.0.0, the following dependencies have been upgraded as well: ml-dtype>=0.4.0, h5py>=3.11.0, and scipy>=1.13.0.

Maintain lock files and an env file for follow up numpy1 jobs as planned.

PiperOrigin-RevId: 676114036
 2024-09-18 13:47:34 -07:00
A. Unique TensorFlower 6371e2a7b1 Fix Python 3.13 installation in ARM64 container 
Python 3.13 does not have a `-distutils` package, so we need to skip that step when installing it.

PiperOrigin-RevId: 676046157
 2024-09-18 11:01:07 -07:00
A. Unique TensorFlower a8125e3362 Add Python 3.13.0rc2 to JAX Docker images with CUDA 12.3 and CUDA 12.1. 
PiperOrigin-RevId: 675594645
 2024-09-17 09:29:19 -07:00
TensorFlower Gardener cd31c69bba Merge pull request #74946 from tensorflow:dependabot/docker/ci/official/containers/linux_arm64/ubuntu-fa17826 
PiperOrigin-RevId: 672443580
 2024-09-09 01:37:15 -07:00
Kanglan Tang 47d314be6d Disable TF numpy2 nightly upload 
PiperOrigin-RevId: 670752256
 2024-09-03 17:06:06 -07:00
dependabot[bot] 62eaeca0aa Bump ubuntu in /ci/official/containers/linux_arm64 
Bumps ubuntu from `0b89735` to `fa17826`.

---
updated-dependencies:
- dependency-name: ubuntu
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-09-01 08:30:03 +00:00
Alexis Praga fe3c0659eb Removing distutils leftover 2024-08-31 19:08:17 +02:00
Kanglan Tang 2b1bf57463 [Numpy] Prepare TF CI scripts for NumPy 2.0 
PiperOrigin-RevId: 667633649
 2024-08-26 11:13:37 -07:00
A. Unique TensorFlower d9071b91c4 Refactor hermetic CUDA flags and update --config=cuda to add CUDA dependencies both for bazel build and bazel test phases. 
Add `--@local_config_cuda//cuda:override_include_cuda_libs` to override settings for TF wheel.

Forbid building TF wheel with `--@local_config_cuda//cuda:include_cuda_libs=true`

PiperOrigin-RevId: 666848518
 2024-08-23 11:43:31 -07:00
Vladimir Belitskiy d2c9b3207d Add a Dockerfile for Windows. 
PiperOrigin-RevId: 665333905
 2024-08-20 06:57:04 -07:00
Michael Hudgins 3ea65e951c Add clang to the path in the ARM64 Dockerfile. 
PiperOrigin-RevId: 663760460
 2024-08-16 10:41:52 -07:00
A. Unique TensorFlower 9b5fa66dc6 Introduce hermetic CUDA in Google ML projects. 
1) Hermetic CUDA rules allow building wheels with GPU support on a machine without GPUs, as well as running Bazel GPU tests on a machine with only GPUs and NVIDIA driver installed. When `--config=cuda` is provided in Bazel options, Bazel will download CUDA, CUDNN and NCCL redistributions in the cache, and use them during build and test phases.

    [Default location of CUNN redistributions](https://developer.download.nvidia.com/compute/cudnn/redist/)

    [Default location of CUDA redistributions](https://developer.download.nvidia.com/compute/cuda/redist/)

    [Default location of NCCL redistributions](https://pypi.org/project/nvidia-nccl-cu12/#history)

2) To include hermetic CUDA rules in your project, add the following in the WORKSPACE of the downstream project dependent on XLA.

   Note: use `@local_tsl` instead of `@tsl` in Tensorflow project.

   ```
   load(
      "@tsl//third_party/gpus/cuda/hermetic:cuda_json_init_repository.bzl",
      "cuda_json_init_repository",
   )

   cuda_json_init_repository()

   load(
      "@cuda_redist_json//:distributions.bzl",
      "CUDA_REDISTRIBUTIONS",
      "CUDNN_REDISTRIBUTIONS",
   )
   load(
      "@tsl//third_party/gpus/cuda/hermetic:cuda_redist_init_repositories.bzl",
      "cuda_redist_init_repositories",
      "cudnn_redist_init_repository",
   )

   cuda_redist_init_repositories(
      cuda_redistributions = CUDA_REDISTRIBUTIONS,
   )

   cudnn_redist_init_repository(
      cudnn_redistributions = CUDNN_REDISTRIBUTIONS,
   )

   load(
      "@tsl//third_party/gpus/cuda/hermetic:cuda_configure.bzl",
      "cuda_configure",
   )

   cuda_configure(name = "local_config_cuda")

   load(
      "@tsl//third_party/nccl/hermetic:nccl_redist_init_repository.bzl",
      "nccl_redist_init_repository",
   )

   nccl_redist_init_repository()

   load(
      "@tsl//third_party/nccl/hermetic:nccl_configure.bzl",
      "nccl_configure",
   )

   nccl_configure(name = "local_config_nccl")
   ```

PiperOrigin-RevId: 662981325
 2024-08-14 11:47:44 -07:00
Vladimir Belitskiy 01297b1f03 Remove an unused Windows Dockerfile. 
Some parts of it will likely be re-used in a different Dockerfile.

PiperOrigin-RevId: 662087070
 2024-08-12 09:00:39 -07:00
Vladimir Belitskiy 59e5836d01 Minor comment cleanup for Docker-related setup. 
PiperOrigin-RevId: 661279002
 2024-08-09 09:05:18 -07:00
Vladimir Belitskiy afda4b24c4 Modify the remoteip filter to match the exact IP address of the container. 
This will address both the cases where the IP container doesn't match the current filter, as well as the currently overly permissive nature of the filter.

Since it is the only one we care about.

PiperOrigin-RevId: 660915155
 2024-08-08 11:56:09 -07:00
Vladimir Belitskiy 7f03e159cd Set up a new Windows presubmit, and have it use the pycpp.sh script. 
PiperOrigin-RevId: 660554802
 2024-08-07 16:01:25 -07:00
TensorFlower Gardener 22042baf8e Merge pull request #72944 from tensorflow:dependabot/docker/ci/devinfra/docker_windows/dotnet/framework/sdk-04e06ae 
PiperOrigin-RevId: 660250063
 2024-08-06 23:55:02 -07:00
Quoc Truong 714490b3ef Remove gcr.io image reference in Linux ARM64 container build.sh as this has been migrated to Artifact Registry. 
PiperOrigin-RevId: 658409481
 2024-08-01 08:44:57 -07:00
dependabot[bot] b4f0981d18 Bump dotnet/framework/sdk in /ci/devinfra/docker_windows 
Bumps dotnet/framework/sdk from `c1b2be1` to `04e06ae`.

---
updated-dependencies:
- dependency-name: dotnet/framework/sdk
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-08-01 08:24:54 +00:00
Nitin Srinivasan 3735c15ed4 Change the naming of the installer wheel envs 
PiperOrigin-RevId: 656386934
 2024-07-26 07:26:18 -07:00