M1, grpc from source, fails with "Library not loaded" error

[LER0ever]

homebrew-core: master Homebrew/homebrew-core@6a292e1
OS: macOS 11.1.0 Big Sur
Model: MacBook Air (M1, 2020)

Installed grpc from source by: brew install --build-from-source grpc, completes without error. brew doctor says everything's fine.

But brew test grpc failed with the following output:

❯ brew test grpc     
==> Testing grpc
==> /usr/bin/clang test.cpp -I/opt/homebrew/Cellar/grpc/1.33.2_3/include -L/opt/homebrew/Cellar/grpc/1.33.2_3/lib -lgrpc -o t
==> ./test
Last 15 lines from /Users/rongyi/Library/Logs/Homebrew/grpc/test.02.test:
2021-01-08 21:05:00 +0800

./test

dyld: Library not loaded: @rpath/libgpr.13.dylib
  Referenced from: /opt/homebrew/opt/grpc/lib/libgrpc.13.dylib
  Reason: image not found
Error: grpc: failed
An exception occurred within a child process:
  BuildError: Failed executing: ./test
/opt/homebrew/Library/Homebrew/formula.rb:2096:in `block in system'
/opt/homebrew/Library/Homebrew/formula.rb:2032:in `open'
/opt/homebrew/Library/Homebrew/formula.rb:2032:in `system'
/opt/homebrew/Library/Taps/homebrew/homebrew-core/Formula/grpc.rb:82:in `block in <class:Grpc>'
/opt/homebrew/Library/Homebrew/formula.rb:1900:in `block (3 levels) in run_test'
/opt/homebrew/Library/Homebrew/utils.rb:530:in `with_env'
/opt/homebrew/Library/Homebrew/formula.rb:1899:in `block (2 levels) in run_test'
/opt/homebrew/Library/Homebrew/formula.rb:904:in `with_logging'
/opt/homebrew/Library/Homebrew/formula.rb:1898:in `block in run_test'
/opt/homebrew/Library/Homebrew/mktemp.rb:63:in `block in run'
/opt/homebrew/Library/Homebrew/mktemp.rb:63:in `chdir'
/opt/homebrew/Library/Homebrew/mktemp.rb:63:in `run'
/opt/homebrew/Library/Homebrew/formula.rb:2145:in `mktemp'
/opt/homebrew/Library/Homebrew/formula.rb:1892:in `run_test'
/opt/homebrew/Library/Homebrew/test.rb:43:in `block in <main>'
/System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/timeout.rb:93:in `block in timeout'
/System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/timeout.rb:33:in `block in catch'
/System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/timeout.rb:33:in `catch'
/System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/timeout.rb:33:in `catch'
/System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/timeout.rb:108:in `timeout'
/opt/homebrew/Library/Homebrew/test.rb:42:in `<main>'

And indeed running grpc_cli shows:

> grpc_cli
dyld: Library not loaded: @rpath/libgrpc++.1.dylib
  Referenced from: /opt/homebrew/bin/grpc_cli
  Reason: image not found
zsh: abort      grpc_cli

Similar issue has been posted in a PR: Homebrew/homebrew-core#68383. This issue happens even on a commit with that PR already merged.

Since I'm not sure if it's reproducible on other M1 machines, I'm posting it here as a discussion. Please let me know if I should open an issue instead.

Screenshot

[SMillerDev]

That commit build an ARM bottle, so you shouldn't need to compile from source.

[LER0ever]

Nope, grpc bottle is not (yet) available for aarch64-apple-darwin. You can verify here: https://formulae.brew.sh/formula/grpc#default , the prebuilt bottles are only available for big_sur, catalina, mojave, but not arm64_big_sur.

Either the ARM bottle build is not automated for every commit, or the automated build didn't manage to build one...?

[carlocab]

grpc hasn't been bottled for ARM (at least partly) because it depends on abseil, which hasn't been bottled for ARM yet either.

We can't do much to help you for formulae that haven't been bottled yet, as the fact that they haven't been bottled is a sign that (at least from our perspective) they're not working properly yet.

However, if you do find a way to build and test abseil and grpc successfully, please open a PR.

[carlocab]

Right, that helps a little. However using DYLD_LIBRARY_PATH isn't an acceptable solution, as that tends to cause plenty of other problems...

[carlocab]

Ok, got it working: Homebrew/homebrew-core#68585

I'll need to think through the implications of the hack I've used though...

[LER0ever]

Thanks! I can confirm that grpc_cli now works without setting DYLD_LIBRARY_PATH. However, while linking grpc in an actual project, I'm hitting Homebrew/homebrew-core#62589 (upstream grpc/grpc#24438). A quick search shows that other projects have had this problem for some time now, e.g. rizsotto/Bear#313 . I'm still trying to figure out what went wrong in the abseil and grpc brew package.

[kellengreen]

abseil now has an arm64_big_sur bottle.

[carlocab]

Yes, see #485 (reply in thread)