pip_import doesn't work with tensorflow #71

vertix · 2018-02-28T15:36:21Z

WORKSPACE

http_archive(
    name = "io_bazel_rules_python",
    sha256 = "0d1810fecc1bf2b6979d2af60e157d93d3004805bd8b7fda6eb52dda13480dca",
    strip_prefix = "rules_python-115e3a0dab4291184fdcb0d4e564a0328364571a",
    urls = ["https://github.com/bazelbuild/rules_python/archive/115e3a0.tar.gz"],
)

load("@io_bazel_rules_python//python:pip.bzl", "pip_import")

pip_import(
    name = "pip",
    requirements = "//:requirements.txt",
)

load("@pip//:requirements.bzl", "pip_install")

pip_install()

requirements.txt

tensorflow

BUILD

load("@io_bazel_rules_python//python:python.bzl", "py_binary")
load("@pip//:requirements.bzl", "requirement")

py_binary(
    name = "test",
    srcs = ["test.py"],
    deps = [
        requirement("tensorflow"),
    ],
)

test.py

import tensorflow as tf

if __name__ == "__main__":
  pass

Raises:
ImportError: 'No module named tensorflow'

jkinkead · 2018-04-09T23:37:45Z

I can confirm. The tensorflow module is completely missing a tensorflow directory after being installed as an external repo:

$ ls /private/var/tmp/_bazel_username/c896bd8ffa3b209834c1217c9406dcf0/external/pypi__tensorflow_1_7_0/
BUILD                      WORKSPACE                  tensorflow-1.7.0.data      tensorflow-1.7.0.dist-info

driveraid · 2018-05-07T13:29:59Z

+1, is there any progress on this issue?

malcolmwhite · 2018-07-05T21:44:37Z

+1

kzadorozhny · 2018-07-27T22:07:08Z

+1

jkinkead · 2018-07-27T23:20:37Z

Note that this is due to issue #92 . There's a workaround posted there for TensorFlow.

lberki · 2018-07-30T07:38:39Z

See https://groups.google.com/d/msg/bazel-sig-python/iQjV9sfSufw/qRtG3toDBAAJ -- short version: expect improvements to our Python rules in August.

jpoehnelt · 2018-08-23T19:05:16Z

Any movement on this? :)

brandjon · 2018-08-23T19:24:35Z

Hi Justin, the movement is that I've taken over maintenance on Python-related issues, including rules_python, though I'm still getting a handle on priorities. Is this issue a regression or was it always broken?

jkinkead · 2018-08-23T22:33:59Z

I'm pretty sure the root cause (#92) has always existed.

therc · 2018-08-23T23:17:20Z

It doesn't seem to have ever worked and it's kinda ironic that what is probably the most popular Bazel project can't be imported from another one through pip. Kinda steers you toward building it through Bazel. Not bad to increase adoption. (That's a silly joke, to be clear.)

therc · 2018-08-23T23:32:55Z

To add more detail: we use TF both by using pip and compiling sources through a nested workspace, so we get to enjoy the worst of both worlds, when it comes to bugs. This issue is our worst pip headache, along with #96 (packages are fetched eagerly when first starting Bazel, rather than lazily when first using them).

jpvelez · 2018-12-04T21:15:46Z

+1

jmhodges · 2019-01-22T05:00:34Z

Yeah, I've just now run into this, too. Running a fork of rules_python to fix this doesn't seem like a great workaround

jmhodges · 2019-01-22T05:03:07Z

(I came to this after giving up on depending on tensorflow as a normal bazel extension, of course. They have that wild user-interaction-required ./configure script you seem to have to run that does a bunch of heuristics on your local filesystem to generate its own bazelrc file. Not great!)

machinelearner452 · 2019-02-12T05:50:16Z

I tried to get tensorflow to load with anaconda and conda. No success with Windows 10, using python 3.6 and 3.5. Any workaround for Windows without using Linux or Microsoft VS 20XX would be appreciated. https://anaconda.org was not of any use I could find.
C:\Users\Joe\Anaconda3\envs\tensorflow>conda install -c conda-forge tensorflow
Collecting package metadata: done
Solving environment: failed

PackagesNotFoundError: The following packages are not available from current channels:

tensorflow

Current channels:

To search for alternate channels that may provide the conda package you're
looking for, navigate to

https://anaconda.org

and use the search bar at the top of the page.

codecakes · 2019-08-01T20:01:17Z

Just wanted a heads up on whether the No module issue here similar to my issue here: #214

ali5h · 2019-10-22T21:14:32Z

try our implementation here https://github.com/ali5h/rules_pip


        Add a wrapper module to import Tensorflow.

This is to workaround a known issue with packaging Tensorflow as a pip dependency in bazel. See: github.com/bazelbuild/rules_python/issues/71 Signed-off-by: format 2020.01.12 <github.com/ChrisCummins/format>


        Add a wrapper module to import Tensorflow.

This is to workaround a known issue with packaging Tensorflow as a pip dependency in bazel. See: github.com/bazelbuild/rules_python/issues/71 Signed-off-by: format 2020.01.12 <github.com/ChrisCummins/format> [Exported from 6e9120c2a18494ae23099965a1a882da046d2c59]


        Add a wrapper module to import Tensorflow.

This is to workaround a known issue with packaging Tensorflow as a pip dependency in bazel. See: github.com/bazelbuild/rules_python/issues/71 Signed-off-by: format 2020.01.12 <github.com/ChrisCummins/format> [Exported from 6e9120c2a18494ae23099965a1a882da046d2c59]


        Add a wrapper module to import Tensorflow.

This is to workaround a known issue with packaging Tensorflow as a pip dependency in bazel. See: github.com/bazelbuild/rules_python/issues/71 Signed-off-by: format 2020.01.12 <github.com/ChrisCummins/format> [Exported from 6e9120c2a18494ae23099965a1a882da046d2c59]


        Add a wrapper module to import Tensorflow.

This is to workaround a known issue with packaging Tensorflow as a pip dependency in bazel. See: github.com/bazelbuild/rules_python/issues/71 Signed-off-by: format 2020.01.12 <github.com/ChrisCummins/format> [Exported from 6e9120c2a18494ae23099965a1a882da046d2c59]


        Add a wrapper module to import Tensorflow.

This is to workaround a known issue with packaging Tensorflow as a pip dependency in bazel. See: github.com/bazelbuild/rules_python/issues/71 Signed-off-by: format 2020.01.12 <github.com/ChrisCummins/format> [Exported from 6e9120c2a18494ae23099965a1a882da046d2c59]


        Add a wrapper module to import Tensorflow.

This is to workaround a known issue with packaging Tensorflow as a pip dependency in bazel. See: github.com/bazelbuild/rules_python/issues/71 Signed-off-by: format 2020.01.12 <github.com/ChrisCummins/format>


        Add a wrapper module to import Tensorflow.

This is to workaround a known issue with packaging Tensorflow as a pip dependency in bazel. See: github.com/bazelbuild/rules_python/issues/71 Signed-off-by: format 2020.01.12 <github.com/ChrisCummins/format>


        Add a wrapper module to import Tensorflow.

This is to workaround a known issue with packaging Tensorflow as a pip dependency in bazel. See: github.com/bazelbuild/rules_python/issues/71 Signed-off-by: format 2020.01.12 <github.com/ChrisCummins/format>


        Add a wrapper module to import Tensorflow.

This is to workaround a known issue with packaging Tensorflow as a pip dependency in bazel. See: github.com/bazelbuild/rules_python/issues/71 Signed-off-by: format 2020.01.12 <github.com/ChrisCummins/format>


        Add a wrapper module to import Tensorflow.

This is to workaround a known issue with packaging Tensorflow as a pip dependency in bazel. See: github.com/bazelbuild/rules_python/issues/71 Signed-off-by: format 2020.01.12 <github.com/ChrisCummins/format>


        Add a wrapper module to import Tensorflow.

This is to workaround a known issue with packaging Tensorflow as a pip dependency in bazel. See: github.com/bazelbuild/rules_python/issues/71 Signed-off-by: format 2020.01.12 <github.com/ChrisCummins/format>


        Add a wrapper module to import Tensorflow.

This is to workaround a known issue with packaging Tensorflow as a pip dependency in bazel. See: github.com/bazelbuild/rules_python/issues/71 Signed-off-by: format 2020.01.12 <github.com/ChrisCummins/format>

carlosgalvezp · 2020-09-07T09:51:13Z

+1, any updates?

thundergolfer · 2020-09-07T09:57:59Z

We're working on incorporating the packaging code from rules_python_external into rules_python. rules_python_external supports importing Tensorflow.

jkinkead mentioned this issue Apr 10, 2018

whl_library ignores purelib / platlib directories #92

Open

duggelz assigned lberki and davidstanke Apr 17, 2018

fferroni mentioned this issue May 8, 2018

ImportError for py_test depending on library, with identical setup bazelbuild/bazel#5115

Closed

lberki assigned brandjon and unassigned davidstanke and lberki Jun 24, 2018

brandjon added the untriaged label Nov 9, 2018

jmsfltchr mentioned this issue Jan 11, 2019

Tensorflow patch graknlabs/rules_python#1

Merged

kerinin mentioned this issue Apr 26, 2019

Support tensorflow (purelib) apt-itude/rules_pip#15

Open

danieljanes mentioned this issue May 29, 2019

py_library import path is wrong for certain pypi packages (like tensorflow) #189

Open

jmcfallargo mentioned this issue Dec 6, 2019

Requesting info about packaging rules, eg. a roadmap #246

Closed

nfelt mentioned this issue Feb 4, 2020

Bazel build recompiles protoc every time PATH changes tensorflow/tensorboard#3213

Open

thundergolfer mentioned this issue Sep 7, 2020

Modify import path of pip package imported via "requirement()" #356

Closed

bazelbuild / rules_python

pip_import doesn't work with tensorflow #71

pip_import doesn't work with tensorflow #71

vertix commented Feb 28, 2018

jkinkead commented Apr 9, 2018

driveraid commented May 7, 2018

malcolmwhite commented Jul 5, 2018

kzadorozhny commented Jul 27, 2018

jkinkead commented Jul 27, 2018

lberki commented Jul 30, 2018

jpoehnelt commented Aug 23, 2018

brandjon commented Aug 23, 2018

jkinkead commented Aug 23, 2018

therc commented Aug 23, 2018

therc commented Aug 23, 2018

jpvelez commented Dec 4, 2018

jmhodges commented Jan 22, 2019

jmhodges commented Jan 22, 2019

machinelearner452 commented Feb 12, 2019

codecakes commented Aug 1, 2019

ali5h commented Oct 22, 2019

carlosgalvezp commented Sep 7, 2020

thundergolfer commented Sep 7, 2020

bazelbuild / rules_python

Join GitHub today

pip_import doesn't work with tensorflow #71

pip_import doesn't work with tensorflow #71

Comments

vertix commented Feb 28, 2018

jkinkead commented Apr 9, 2018

driveraid commented May 7, 2018

malcolmwhite commented Jul 5, 2018

kzadorozhny commented Jul 27, 2018

jkinkead commented Jul 27, 2018

lberki commented Jul 30, 2018

jpoehnelt commented Aug 23, 2018

brandjon commented Aug 23, 2018

jkinkead commented Aug 23, 2018

therc commented Aug 23, 2018

therc commented Aug 23, 2018

jpvelez commented Dec 4, 2018

jmhodges commented Jan 22, 2019

jmhodges commented Jan 22, 2019

machinelearner452 commented Feb 12, 2019

codecakes commented Aug 1, 2019

ali5h commented Oct 22, 2019

carlosgalvezp commented Sep 7, 2020

thundergolfer commented Sep 7, 2020