Azure Devops Android Release to Google Play Store failing - xamarin.android

A release pipeline for xamarin.android is failing. There is one task in this release:
Publish to Google Play store
I have added JSON file from the developer play console
APK file path from Artifacts.
and given the package name.
Its failing with following message:
2020-06-26T14:40:02.8690362Z ##[error]System.Management.Automation.RemoteException: Traceback (most recent call last):
2020-06-26T14:40:02.8692807Z ##[error]System.Management.Automation.RemoteException: File "D:\a_tasks\publishPlaystore_20810fda-9c24-482a-a00c-6fcc16b30fd0\1.0.1\upload_apks_with_listing.py", line 27, in
2020-06-26T14:40:02.8693469Z from oauth2client import tools
2020-06-26T14:40:02.8693671Z ModuleNotFoundError: No module named 'oauth2client'
Full logs are here:
2020-06-26T14:39:15.5941331Z ==============================================================================
2020-06-26T14:39:15.5941643Z Task : Publish to Google Play Store
2020-06-26T14:39:15.5941916Z Description : Publish your APK to Google Play Store (Alpha, Beta, Production or Rollout)
2020-06-26T14:39:15.5942148Z Version : 1.0.1
2020-06-26T14:39:15.5942322Z Author : Alexandre Chohfi
2020-06-26T14:39:15.5943117Z Help : [More Information](https://github.com/azchohfi/vsts-task-publish-playstore)
2020-06-26T14:39:15.5943433Z ==============================================================================
2020-06-26T14:39:15.6000016Z ##[warning]Task 'publishPlaystore' (1.0.1) is using deprecated task execution handler. The task should use the supported task-lib: https://aka.ms/tasklib
2020-06-26T14:39:15.6009131Z Preparing task execution handler.
2020-06-26T14:39:32.5231135Z Executing the powershell script: D:\a\_tasks\publishPlaystore_20810fda-9c24-482a-a00c-6fcc16b30fd0\1.0.1\publish.ps1
2020-06-26T14:39:32.8402613Z com.healthbit.app
2020-06-26T14:39:32.8407837Z D:\a\r1\a/_Healthbit Master-Xamarin.Android-CI/drop/com.healthbit.app.apk
2020-06-26T14:39:33.3275969Z Python 3.7.7
2020-06-26T14:39:33.3276966Z C:\hostedtoolcache\windows\Python\3.7.7\x64\python.exe
2020-06-26T14:39:33.3277344Z C:\hostedtoolcache\windows\Python\3.7.7\x64\scripts\pip.exe
2020-06-26T14:39:42.4806332Z Collecting pip
2020-06-26T14:39:42.5276657Z Downloading pip-20.1.1-py2.py3-none-any.whl (1.5 MB)
2020-06-26T14:39:43.1169997Z Collecting wheel
2020-06-26T14:39:43.1231804Z Downloading wheel-0.34.2-py2.py3-none-any.whl (26 kB)
2020-06-26T14:39:43.1986490Z Installing collected packages: pip, wheel
2020-06-26T14:39:43.1986964Z Attempting uninstall: pip
2020-06-26T14:39:43.1993275Z Found existing installation: pip 20.1.1
2020-06-26T14:39:46.2729697Z Uninstalling pip-20.1.1:
2020-06-26T14:39:46.2925429Z Successfully uninstalled pip-20.1.1
2020-06-26T14:39:49.9060249Z Successfully installed pip-20.1.1 wheel-0.34.2
2020-06-26T14:39:50.6454675Z Collecting google-api-python-client
2020-06-26T14:39:50.6739591Z Downloading google_api_python_client-1.9.3-py3-none-any.whl (59 kB)
2020-06-26T14:39:50.7797649Z Collecting google-auth-httplib2>=0.0.3
2020-06-26T14:39:50.7860607Z Downloading google_auth_httplib2-0.0.3-py2.py3-none-any.whl (6.3 kB)
2020-06-26T14:39:50.9207074Z Collecting google-auth>=1.16.0
2020-06-26T14:39:50.9295217Z Downloading google_auth-1.18.0-py2.py3-none-any.whl (90 kB)
2020-06-26T14:39:51.0565346Z Collecting six<2dev,>=1.6.1
2020-06-26T14:39:51.0679431Z Downloading six-1.15.0-py2.py3-none-any.whl (10 kB)
2020-06-26T14:39:51.1535589Z Collecting uritemplate<4dev,>=3.0.0
2020-06-26T14:39:51.1595257Z Downloading uritemplate-3.0.1-py2.py3-none-any.whl (15 kB)
2020-06-26T14:39:51.2806441Z Collecting google-api-core<2dev,>=1.18.0
2020-06-26T14:39:51.2900495Z Downloading google_api_core-1.21.0-py2.py3-none-any.whl (90 kB)
2020-06-26T14:39:51.4234837Z Collecting httplib2<1dev,>=0.9.2
2020-06-26T14:39:51.4322339Z Downloading httplib2-0.18.1-py3-none-any.whl (95 kB)
2020-06-26T14:39:51.5281857Z Collecting cachetools<5.0,>=2.0.0
2020-06-26T14:39:51.5358573Z Downloading cachetools-4.1.0-py3-none-any.whl (10 kB)
2020-06-26T14:39:51.6647838Z Collecting rsa<5,>=3.1.4; python_version >= "3"
2020-06-26T14:39:51.6721504Z Downloading rsa-4.6-py3-none-any.whl (47 kB)
2020-06-26T14:39:51.7388718Z Requirement already satisfied, skipping upgrade: setuptools>=40.3.0 in c:\hostedtoolcache\windows\python\3.7.7\x64\lib\site-packages (from google-auth>=1.16.0->google-api-python-client) (41.2.0)
2020-06-26T14:39:51.8327957Z Collecting pyasn1-modules>=0.2.1
2020-06-26T14:39:51.8392193Z Downloading pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
2020-06-26T14:39:52.0387337Z Collecting requests<3.0.0dev,>=2.18.0
2020-06-26T14:39:52.0467660Z Downloading requests-2.24.0-py2.py3-none-any.whl (61 kB)
2020-06-26T14:39:52.1511827Z Collecting googleapis-common-protos<2.0dev,>=1.6.0
2020-06-26T14:39:52.1590625Z Downloading googleapis_common_protos-1.52.0-py2.py3-none-any.whl (100 kB)
2020-06-26T14:39:52.3786714Z Collecting protobuf>=3.12.0
2020-06-26T14:39:52.3881114Z Downloading protobuf-3.12.2-cp37-cp37m-win_amd64.whl (1.0 MB)
2020-06-26T14:39:52.7079539Z Collecting pytz
2020-06-26T14:39:52.7150406Z Downloading pytz-2020.1-py2.py3-none-any.whl (510 kB)
2020-06-26T14:39:53.4366923Z Collecting pyasn1>=0.1.3
2020-06-26T14:39:53.4460062Z Downloading pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
2020-06-26T14:39:53.5813789Z Collecting urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1
2020-06-26T14:39:53.5879323Z Downloading urllib3-1.25.9-py2.py3-none-any.whl (126 kB)
2020-06-26T14:39:53.7408810Z Collecting chardet<4,>=3.0.2
2020-06-26T14:39:53.7481648Z Downloading chardet-3.0.4-py2.py3-none-any.whl (133 kB)
2020-06-26T14:39:53.8918463Z Collecting certifi>=2017.4.17
2020-06-26T14:39:53.8978979Z Downloading certifi-2020.6.20-py2.py3-none-any.whl (156 kB)
2020-06-26T14:39:53.9964691Z Collecting idna<3,>=2.5
2020-06-26T14:39:54.0035221Z Downloading idna-2.9-py2.py3-none-any.whl (58 kB)
2020-06-26T14:39:54.1249759Z Installing collected packages: cachetools, pyasn1, rsa, pyasn1-modules, six, google-auth, httplib2, google-auth-httplib2, uritemplate, urllib3, chardet, certifi, idna, requests, protobuf, googleapis-common-protos, pytz, google-api-core, google-api-python-client
2020-06-26T14:40:01.9193298Z Successfully installed cachetools-4.1.0 certifi-2020.6.20 chardet-3.0.4 google-api-core-1.21.0 google-api-python-client-1.9.3 google-auth-1.18.0 google-auth-httplib2-0.0.3 googleapis-common-protos-1.52.0 httplib2-0.18.1 idna-2.9 protobuf-3.12.2 pyasn1-0.4.8 pyasn1-modules-0.2.8 pytz-2020.1 requests-2.24.0 rsa-4.6 six-1.15.0 uritemplate-3.0.1 urllib3-1.25.9
2020-06-26T14:40:02.8690362Z ##[error]System.Management.Automation.RemoteException: Traceback (most recent call last):
2020-06-26T14:40:02.8692807Z ##[error]System.Management.Automation.RemoteException: File "D:\a\_tasks\publishPlaystore_20810fda-9c24-482a-a00c-6fcc16b30fd0\1.0.1\upload_apks_with_listing.py", line 27, in <module>
2020-06-26T14:40:02.8693469Z from oauth2client import tools
2020-06-26T14:40:02.8693671Z ModuleNotFoundError: No module named 'oauth2client'
2020-06-26T14:40:02.8693816Z
2020-06-26T14:40:02.9026231Z ##[error]PowerShell script completed with 2 errors.
2020-06-26T14:40:02.9035336Z ##[section]Finishing: Publish to Google Play Store

From the error log, the ModuleNotFoundError: No module named 'oauth2client'seems to be the root cause of this issue.
The oauth2client module is missing.
To solve this issue, you could add a Command Line task before the Publish to Google Play Store task.
Then you could run the script to install it.
steps:
- script: 'pip install -t {path} google-api-python-client oauth2client'
This is the ticket I referenced
Hope this helps.

Related

MikTex, package miktex-latex could not be installed

I "upgraded" from Windows 10 to Windows 11, and my MikTex developed problems. It still works, but gives this warning:
======================================================================
starting package maintenance...
installation directory: C:\Users\ccc31\AppData\Local\Programs\MiKTeX
package repository: https://mirror2.sandyriver.net/pub/ctan/systems/win32/miktex/tm/packages/
package repository digest: 01f4511dd3ba7934c7348b504d466b34
going to download 1262 bytes
going to install 4 file(s) (1 package(s))
downloading https://mirror2.sandyriver.net/pub/ctan/systems/win32/miktex/tm/packages/miktex-latex.tar.lzma...
0.00 MB, 0.03 Mbit/s
Unfortunately, the package miktex-latex could not be installed.
Please check the log file:
C:\Users\ccc31\AppData\Local\MiKTeX\miktex\log\pdflatex.log
======================================================================
I noticed from my settings file it says the OS is Windows 10. Here is a portion of my settings file:
ReportDate: 2023-01-31 16:00:55
CurrentVersion: 20.7
SetupDate: 2022-12-19 12:42:00
SetupVersion: 20.6.29
Configuration: Regular
GitInfo: d26133b / 2020-07-31 18:20:50
OS: Windows 10 Home, 64-bit, build 22621
SharedSetup: no
LinkTargetDirectory: C:\Program Files\MiKTeX\miktex\bin\x64
PathOkay: yes
LastUpdateCheck: 2023-01-31 15:48:30
LastUpdate: 2023-01-31 15:49:21
LastUpdateDb: 2023-01-31 15:50:42
SystemAdmin: yes
RootPrivileges: no
AdminMode: no
In trying to troubleshoot this problem, I noticed that I had Miktex in \Program Files and also in AppData\Local\Programs. I am a long time user of latexpdf, so it wouldn't surprise me to learn that I had installed it multiple times in multiple locations.
Any hints on how to diagnose the warning, and how to fix it? Thanks.

staging beam sdk and suggestion of "pre-building workflow..." expected?

I run beam pipeline with the following on python3.8 and beam2.41.0rc1:
argv = [
"--runner", "DataflowRunner",
"--experiments=use_runner_v2",
"--sdk_container_image=us.gcr.io/some_beam_image_based_on_2.41.0rc1",
]
The beam image is built with bazel docker rules:
In WORKSPACE
# https://hub.docker.com/r/apache/beam_python3.8_sdk/tags
container_pull(
name = "beam_python",
# 2.41.0rc1
digest = "sha256:0036b90ecfefddd1dd1614b9cd1ccec7c5a906ee2185542996bc26d6408d9e14",
registry = "registry.hub.docker.com",
repository = "apache/beam_python3.8_sdk",
)
In BUILD
cc_image(
name = "sample_image",
binary = ":sample",
)
container_layer(
name = "sample_layer",
tars = [":sample_image"],
)
container_image(
name = "beam_sample_image",
base = "#beam_python//image",
layers = [":sample_layer"],
)
A custom apache-beam seems installed. Not sure if it is 2.41.0rc1.
root#3dc8fe29cd99:/# pip freeze
absl-py==1.2.0
apache-beam # file:///opt/apache/beam/tars/apache-beam.tar.gz
astunparse==1.6.3
atomicwrites==1.4.1
attrs==21.4.0
beautifulsoup4==4.11.1
...
I saw the following log:
I0815 18:11:40.158377 140374774146880 stager.py:927] Downloading source distribution of the SDK from PyPi
I0815 18:11:40.158492 140374774146880 stager.py:934] Executing command: ['/home/swang/.cache/bazel/_bazel_swang/09eb83215bfa3a8425e4385b45dbf00d/execroot/__main__/bazel-out/k8-opt/bin/garage/sample_launch.runfiles/python3_8_x86_64-unknown-linux-gnu/bin/python3', '-m', 'pip', 'download', '--dest', '/tmp/tmpuqnjdrj3', 'apache-beam==2.41.0rc1', '--no-deps', '--no-binary', ':all:']
WARNING: You are using pip version 22.0.4; however, version 22.2.2 is available.
You should consider upgrading via the '/home/swang/.cache/bazel/_bazel_swang/09eb83215bfa3a8425e4385b45dbf00d/execroot/__main__/bazel-out/k8-opt/bin/garage/sample_launch.runfiles/python3_8_x86_64-unknown-linux-gnu/bin/python3 -m pip install --upgrade pip' command.
I0815 18:11:42.881979 140374774146880 stager.py:825] Staging SDK sources from PyPI: dataflow_python_sdk.tar
I0815 18:11:42.883261 140374774146880 stager.py:900] Downloading binary distribution of the SDK from PyPi
I0815 18:11:42.883335 140374774146880 stager.py:934] Executing command: ['/home/swang/.cache/bazel/_bazel_swang/09eb83215bfa3a8425e4385b45dbf00d/execroot/__main__/bazel-out/k8-opt/bin/garage/sample_launch.runfiles/python3_8_x86_64-unknown-linux-gnu/bin/python3', '-m', 'pip', 'download', '--dest', '/tmp/tmpuqnjdrj3', 'apache-beam==2.41.0rc1', '--no-deps', '--only-binary', ':all:', '--python-version', '38', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux1_x86_64']
WARNING: You are using pip version 22.0.4; however, version 22.2.2 is available.
You should consider upgrading via the '/home/swang/.cache/bazel/_bazel_swang/09eb83215bfa3a8425e4385b45dbf00d/execroot/__main__/bazel-out/k8-opt/bin/garage/sample_launch.runfiles/python3_8_x86_64-unknown-linux-gnu/bin/python3 -m pip install --upgrade pip' command.
I0815 18:11:44.672350 140374774146880 stager.py:842] Staging binary distribution of the SDK from PyPI: apache_beam-2.41.0rc1-cp38-cp38-manylinux1_x86_64.whl
I0815 18:11:44.675273 140374774146880 dataflow_runner.py:477] Pipeline has additional dependencies to be installed in SDK worker container, consider using the SDK container image pre-building workflow to avoid repetitive installations. Learn more on https://cloud.google.com/dataflow/docs/guides/using-custom-containers#prebuild
I0815 18:11:44.676919 140374774146880 environments.py:376] Default Python SDK image for environment is apache/beam_python3.8_sdk:2.41.0rc1
I0815 18:11:44.677026 140374774146880 environments.py:295] Using provided Python SDK container image: us.gcr.io/shawn-295406/beam_sample:20220815_test
I0815 18:11:44.677081 140374774146880 environments.py:302] Python SDK container image set to "us.gcr.io/shawn-295406/beam_sample:20220815_test" for Docker environment
I0815 18:11:44.723044 140374774146880 translations.py:714] ==================== <function pack_combiners at 0x7fab84d77820> ====================
I0815 18:11:44.723375 140374774146880 translations.py:714] ==================== <function sort_stages at 0x7fab84d78040> ====================
I0815 18:11:44.730723 140374774146880 apiclient.py:473] Defaulting to the temp_location as staging_location: gs://shizhiw/beam/tmp
I0815 18:11:44.750272 140374774146880 auth.py:136] Setting socket default timeout to 60 seconds.
I0815 18:11:44.750348 140374774146880 auth.py:138] socket default timeout is 60.0 seconds.
I0815 18:11:44.755919 140374774146880 apiclient.py:732] Starting GCS upload to gs://shizhiw/beam/tmp/beamapp-swang-0816011144-730582-ppdswudf.1660612304.730851/dataflow_python_sdk.tar...
I0815 18:11:45.899281 140374774146880 apiclient.py:748] Completed GCS upload to gs://shizhiw/beam/tmp/beamapp-swang-0816011144-730582-ppdswudf.1660612304.730851/dataflow_python_sdk.tar in 1 seconds.
I0815 18:11:45.899615 140374774146880 apiclient.py:732] Starting GCS upload to gs://shizhiw/beam/tmp/beamapp-swang-0816011144-730582-ppdswudf.1660612304.730851/apache_beam-2.41.0rc1-cp38-cp38-manylinux1_x86_64.whl...
I0815 18:11:48.883744 140374774146880 apiclient.py:748] Completed GCS upload to gs://shizhiw/beam/tmp/beamapp-swang-0816011144-730582-ppdswudf.1660612304.730851/apache_beam-2.41.0rc1-cp38-cp38-manylinux1_x86_64.whl in 2 seconds.
I0815 18:11:48.884612 140374774146880 apiclient.py:732] Starting GCS upload to gs://shizhiw/beam/tmp/beamapp-swang-0816011144-730582-ppdswudf.1660612304.730851/pipeline.pb...
I0815 18:11:49.025467 140374774146880 apiclient.py:748] Completed GCS upload to gs://shizhiw/beam/tmp/beamapp-swang-0816011144-730582-ppdswudf.1660612304.730851/pipeline.pb in 0 seconds.
I0815 18:11:49.855348 140374774146880 apiclient.py:911] Create job: <Job
I'm a bit puzzled by the log:
beam is already installed both locally and in the container image, why does it seem to be downloaded again?
I'm already using custom container (base beam image + a cpp binary), why does the log still suggest me to use "pre-building workflow..."?
The apache-beam # file:///opt/apache/beam/tars/apache-beam.tar.gz basically says the Beam is installed from a tarball file on the container. It must be the 2.41.0rc1 pulled in as the base image in your Dockerfile or build system.
The info you are seeing is benign, see this line. It's logged whenever your pipeline options contain additional artifacts to retrieve. In your case, just the sdk_container_image.

Docker build vs Docker run don't behave the same

I try to build a Docker image with an Archlinux base.
The problem is that I don't have the same result when building the docker image and when doing commands by hand.
$ cat Dockerfile
FROM archlinux/base
RUN pacman -Suy --noconfirm --noprogressbar
$ docker build .
#1 [internal] load .dockerignore
#1 transferring context: 2B done
#1 DONE 0.3s
#2 [internal] load build definition from Dockerfile
#2 transferring dockerfile: 37B done
#2 DONE 0.2s
#3 [internal] load metadata for docker.io/archlinux/base:latest
#3 DONE 0.0s
#4 [1/2] FROM docker.io/archlinux/base
#4 CACHED
#5 [2/2] RUN pacman -Suy --noconfirm --noprogressbar
#5 0.692 :: Synchronizing package databases...
#5 1.449 downloading core.db...
#5 3.139 downloading extra.db...
#5 8.344 downloading community.db...
#5 15.38 :: Starting full system upgrade...
#5 15.40 resolving dependencies...
#5 15.55 looking for conflicting packages...
#5 15.56
#5 15.56 Packages (26) archlinux-keyring-20200820-1 bash-5.0.018-1 ca-certificates-mozilla-3.56-1 curl-7.72.0-2 file-5.39-1 filesystem-2020.08.21-1 gcc-libs-10.2.0-1 glib2-2.64.5-1 glibc-2.32-3 hwids-20200813.1-1 iana-etc-20200812-1 kbd-2.3.0-2 libcap-2.42-1 libgpg-error-1.39-1 libp11-kit-0.23.21-1 libutil-linux-2.36-2 libxcrypt-4.4.17-1 linux-api-headers-5.7-1 p11-kit-0.23.21-1 pacman-mirrorlist-20200801-1 pam-1.4.0-3 pambase-20200721.1-2 sqlite-3.33.0-2 systemd-246.3-1 systemd-libs-246.3-1 util-linux-2.36-2
#5 15.56
#5 15.56 Total Download Size: 63.83 MiB
#5 15.56 Total Installed Size: 297.78 MiB
#5 15.56 Net Upgrade Size: 7.41 MiB
#5 15.56
#5 15.56 :: Proceed with installation? [Y/n]
#5 15.56 :: Retrieving packages...
#5 15.94 downloading archlinux-keyring-20200820-1-any.pkg.tar.zst...
#5 18.60 downloading linux-api-headers-5.7-1-any.pkg.tar.zst...
#5 21.09 downloading iana-etc-20200812-1-any.pkg.tar.zst...
#5 23.08 downloading filesystem-2020.08.21-1-x86_64.pkg.tar.zst...
#5 23.73 downloading glibc-2.32-3-x86_64.pkg.tar.zst...
#5 30.46 downloading gcc-libs-10.2.0-1-x86_64.pkg.tar.zst...
#5 38.65 downloading bash-5.0.018-1-x86_64.pkg.tar.zst...
#5 42.37 downloading libp11-kit-0.23.21-1-x86_64.pkg.tar.zst...
#5 44.24 downloading libcap-2.42-1-x86_64.pkg.tar.zst...
#5 44.99 downloading libgpg-error-1.39-1-x86_64.pkg.tar.zst...
#5 46.48 downloading systemd-libs-246.3-1-x86_64.pkg.tar.zst...
#5 48.72 downloading p11-kit-0.23.21-1-x86_64.pkg.tar.zst...
#5 50.07 downloading ca-certificates-mozilla-3.56-1-x86_64.pkg.tar.zst...
#5 52.28 downloading libutil-linux-2.36-2-x86_64.pkg.tar.zst...
#5 54.72 downloading curl-7.72.0-2-x86_64.pkg.tar.zst...
#5 57.60 downloading glib2-2.64.5-1-x86_64.pkg.tar.zst...
#5 60.93 downloading hwids-20200813.1-1-any.pkg.tar.zst...
#5 63.00 downloading pambase-20200721.1-2-any.pkg.tar.zst...
#5 63.38 downloading pam-1.4.0-3-x86_64.pkg.tar.zst...
#5 65.26 downloading kbd-2.3.0-2-x86_64.pkg.tar.zst...
#5 68.25 downloading pacman-mirrorlist-20200801-1-any.pkg.tar.zst...
#5 68.63 downloading sqlite-3.33.0-2-x86_64.pkg.tar.zst...
#5 72.16 downloading libxcrypt-4.4.17-1-x86_64.pkg.tar.zst...
#5 73.20 downloading file-5.39-1-x86_64.pkg.tar.zst...
#5 75.09 downloading util-linux-2.36-2-x86_64.pkg.tar.zst...
#5 79.08 downloading systemd-246.3-1-x86_64.pkg.tar.zst...
#5 85.13 checking keyring...
#5 85.28 checking package integrity...
#5 86.18 loading package files...
#5 86.21 checking for file conflicts...
#5 86.21 checking available disk space...
#5 86.23 error: Partition /etc/resolv.conf is mounted read only
#5 86.23 error: Partition /etc/hosts is mounted read only
#5 86.23 error: not enough free disk space
#5 86.23 error: failed to commit transaction (not enough free disk space)
#5 86.24 Errors occurred, no packages were upgraded.
#5 ERROR: executor failed running [/bin/sh -c pacman -Suy --noconfirm --noprogressbar]: runc did not terminate sucessfully
------
> [2/2] RUN pacman -Suy --noconfirm --noprogressbar:
------
failed to solve with frontend dockerfile.v0: failed to build LLB: executor failed running [/bin/sh -c pacman -Suy --noconfirm --noprogressbar]: runc did not terminate sucessfully
This fails, I don't understand why.
Same command in a fresh container:
$ docker run --rm archlinux/base pacman -Suy --noconfirm --noprogressbar
:: Synchronizing package databases...
downloading core.db...
downloading extra.db...
downloading community.db...
:: Starting full system upgrade...
resolving dependencies...
looking for conflicting packages...
Packages (26) archlinux-keyring-20200820-1 bash-5.0.018-1 ca-certificates-mozilla-3.56-1 curl-7.72.0-2 file-5.39-1 filesystem-2020.08.21-1 gcc-libs-10.2.0-1 glib2-2.64.5-1 glibc-2.32-3 hwids-20200813.1-1 iana-etc-20200812-1 kbd-2.3.0-2 libcap-2.42-1 libgpg-error-1.39-1 libp11-kit-0.23.21-1 libutil-linux-2.36-2 libxcrypt-4.4.17-1 linux-api-headers-5.7-1 p11-kit-0.23.21-1 pacman-mirrorlist-20200801-1 pam-1.4.0-3 pambase-20200721.1-2 sqlite-3.33.0-2 systemd-246.3-1 systemd-libs-246.3-1 util-linux-2.36-2
Total Download Size: 63.83 MiB
Total Installed Size: 297.78 MiB
Net Upgrade Size: 7.41 MiB
:: Proceed with installation? [Y/n]
:: Retrieving packages...
downloading archlinux-keyring-20200820-1-any.pkg.tar.zst...
downloading linux-api-headers-5.7-1-any.pkg.tar.zst...
downloading iana-etc-20200812-1-any.pkg.tar.zst...
downloading filesystem-2020.08.21-1-x86_64.pkg.tar.zst...
downloading glibc-2.32-3-x86_64.pkg.tar.zst...
downloading gcc-libs-10.2.0-1-x86_64.pkg.tar.zst...
downloading bash-5.0.018-1-x86_64.pkg.tar.zst...
downloading libp11-kit-0.23.21-1-x86_64.pkg.tar.zst...
downloading libcap-2.42-1-x86_64.pkg.tar.zst...
downloading libgpg-error-1.39-1-x86_64.pkg.tar.zst...
downloading systemd-libs-246.3-1-x86_64.pkg.tar.zst...
downloading p11-kit-0.23.21-1-x86_64.pkg.tar.zst...
downloading ca-certificates-mozilla-3.56-1-x86_64.pkg.tar.zst...
downloading libutil-linux-2.36-2-x86_64.pkg.tar.zst...
downloading curl-7.72.0-2-x86_64.pkg.tar.zst...
downloading glib2-2.64.5-1-x86_64.pkg.tar.zst...
downloading hwids-20200813.1-1-any.pkg.tar.zst...
downloading pambase-20200721.1-2-any.pkg.tar.zst...
downloading pam-1.4.0-3-x86_64.pkg.tar.zst...
downloading kbd-2.3.0-2-x86_64.pkg.tar.zst...
downloading pacman-mirrorlist-20200801-1-any.pkg.tar.zst...
downloading sqlite-3.33.0-2-x86_64.pkg.tar.zst...
downloading libxcrypt-4.4.17-1-x86_64.pkg.tar.zst...
downloading file-5.39-1-x86_64.pkg.tar.zst...
downloading util-linux-2.36-2-x86_64.pkg.tar.zst...
downloading systemd-246.3-1-x86_64.pkg.tar.zst...
checking keyring...
checking package integrity...
loading package files...
checking for file conflicts...
checking available disk space...
:: Processing package changes...
upgrading archlinux-keyring...
==> Appending keys from archlinux.gpg...
==> Locally signing trusted keys in keyring...
-> Locally signing key D8AFDDA07A5B6EDFA7D8CCDAD6D055F927843F1C...
==> ERROR: D8AFDDA07A5B6EDFA7D8CCDAD6D055F927843F1C could not be locally signed.
-> Locally signing key DDB867B92AA789C165EEFA799B729B06A680C281...
==> ERROR: DDB867B92AA789C165EEFA799B729B06A680C281 could not be locally signed.
-> Locally signing key 91FFE0700E80619CEB73235CA88E23E377514E00...
==> ERROR: 91FFE0700E80619CEB73235CA88E23E377514E00 could not be locally signed.
-> Locally signing key 0E8B644079F599DFC1DDC3973348882F6AC6A4C2...
==> ERROR: 0E8B644079F599DFC1DDC3973348882F6AC6A4C2 could not be locally signed.
-> Locally signing key AB19265E5D7D20687D303246BA1DFB64FFF979E7...
==> ERROR: AB19265E5D7D20687D303246BA1DFB64FFF979E7 could not be locally signed.
upgrading linux-api-headers...
upgrading iana-etc...
upgrading filesystem...
upgrading glibc...
warning: /etc/locale.gen installed as /etc/locale.gen.pacnew
Generating locales...
en_US.UTF-8... done
Generation complete.
upgrading gcc-libs...
upgrading bash...
upgrading libp11-kit...
upgrading libcap...
upgrading libgpg-error...
upgrading systemd-libs...
upgrading p11-kit...
upgrading ca-certificates-mozilla...
upgrading libutil-linux...
upgrading curl...
upgrading glib2...
upgrading hwids...
upgrading pambase...
upgrading pam...
upgrading kbd...
upgrading pacman-mirrorlist...
warning: /etc/pacman.d/mirrorlist installed as /etc/pacman.d/mirrorlist.pacnew
upgrading sqlite...
installing libxcrypt...
installing file...
upgrading util-linux...
upgrading systemd...
:: Running post-transaction hooks...
( 1/11) Creating system user accounts...
( 2/11) Updating journal message catalog...
( 3/11) Reloading system manager configuration...
Skipped: Current root is not booted.
( 4/11) Updating udev hardware database...
( 5/11) Applying kernel sysctl settings...
Skipped: Current root is not booted.
( 6/11) Creating temporary files...
/usr/lib/tmpfiles.d/journal-nocow.conf:26: Failed to resolve specifier: uninitialized /etc detected, skipping
All rules containing unresolvable specifiers will be skipped.
( 7/11) Reloading device manager configuration...
Skipped: Device manager is not running.
( 8/11) Arming ConditionNeedsUpdate...
( 9/11) Rebuilding certificate stores...
(10/11) Reloading system bus configuration...
Skipped: Current root is not booted.
(11/11) Cleaning up package cache...
What is the diff between them? And how can I have a Dockerfile that works?
Thanks
PS: this is not a space problem (df -h does not show me a "Use%" close to being full)
This seems related to buildkit, as noticed by larsks. /etc/resolv.conf and /etc/hosts are mounted read-only when using buildkit. pacman seems to try to update these files, resulting in the error you see.
As a workaround, you can set the DOCKER_BUILDKIT environment variable from 1 to 0 to disable it. For example:
DOCKER_BUILDKIT=0 docker build .

Can't install libgtk2.0-dev_2.24.31-2_arm64.deb on Renesas R-Car H3 (H3ULCB)

I am trying to run object detection algorithm (which is using OpenCV 2.4.13.7) on H3ULCB. It is giving libGTK as shown below
root#h3ulcb:/media/2.4.13_algo_target_# ./main_
OpenCV Error: Unspecified error (The function is not implemented. Rebuild the library with Windows, GTK+ 2.x or [ 1976.641753] audit: type=1706
Carbon support. If you are on Ubuntu or Debian, install libgtk2.0-dev and pkg-config, then re-run cmake or configure script) in cvWaitKey, fil7
terminate called after throwing an instance of 'cv::Exception'
what(): /media/2.4.13.7_pckage/modules/highgui/src/window.cpp:567: error: (-2) The function is not implemented. Rebuild the library with Wiy
Aborted (core dumped)}
To solve the error , I tried to install libGTK package (libgtk2.0-dev_2.24.31-2_arm64.deb) on H3ULCB, but its not getting installed to the target.
* pkg_extract_data_file_names_to_stream: Failed to extract data.tar.gz from package '/media/libgtk2.0-dev_2.24.31-2_arm64.deb'.
* pkg_get_installed_files: Error extracting file list from /media/libgtk2.0-dev_2.24.31-2_arm64.deb.
* opkg_install: Cannot install package libgtk2.0-dev.
BSP and SDK for H3ULCB are build using yocto, details are listed below:
Yocto version: 2.23
Poky: 2.1.3
The same error is resolved on the native Linux (Ubuntu16.04) by installing the libgtk2.0 library from apt-get manager. But package manager apt and dpkg is not getting installed on the target. I tried to add these managers in the yocto layers while building the image.
Currently Available package manager on H3ULCB is OPKG. Since OPKG works on .IPK packages but not .IPK packages on available for libgtk2.0, I have converted the .deb package to a .IPK package .While executing the .IPK package on H3ulcb:
root#h3ulcb:/media# opkg install libgtk2.0-dev_2.24.31-2_arm64.ipk
Collected errors:
* open_outer: Failed to open package 'libgtk2.0-dev_2.24.31-2_arm64.ipk': Unrecognized archive format
* pkg_extract_control_file_to_stream: Failed to extract control.tar.gz from package 'libgtk2.0-dev_2.24.31-2_arm64.ipk'.
* pkg_init_from_file: Failed to extract control file from libgtk2.0-dev_2.24.31-2_arm64.ipk.
In the package libgtk2.0-dev_2.24.31-2_arm64.deb, there are 3 files
control.tar.gz
data.tar.xz
debian-binary
while executing the .deb file on H3ULCB, the error showed data.tar.gz instead of data.tar.xz as given below:
pkg_extract_data_file_names_to_stream: Failed to extract data.tar.gz from package '/media/libgtk2.0-dev_2.24.31-2_arm64.deb'.
I have converted data.tar.xz to data.tar.gz, but how to pack these files 3 files back to .deb package?

Installing Tweepy using Homebrew

I tried installing Tweepy for python using homebrew by the command brew install tweepy But it showed the following error:
Error: No available formula with the name "tweepy"
==> Searching for similarly named formulae...
Error: No similarly named formulae found.
==> Searching taps...
Error: No formulae found in taps. What command should I use?
Please don't suggest to use pip, I already tried that many times, couldn't succeed.
Edit:
Using pip install tweepy , results in following:
ADITIs-MacBook-Air:~ aditinarware$ pip install tweepy
Collecting tweepy
Downloading tweepy-3.5.0-py2.py3-none-any.whl
Collecting six>=1.7.3 (from tweepy)
Downloading six-1.10.0-py2.py3-none-any.whl
Collecting requests-oauthlib>=0.4.1 (from tweepy)
Downloading requests_oauthlib-0.7.0-py2.py3-none-any.whl
Collecting requests>=2.4.3 (from tweepy)
Downloading requests-2.12.4-py2.py3-none-any.whl (576kB)
100% |████████████████████████████████| 583kB 129kB/s
Collecting oauthlib>=0.6.2 (from requests-oauthlib>=0.4.1->tweepy)
Downloading oauthlib-2.0.1.tar.gz (122kB)
100% |████████████████████████████████| 133kB 117kB/s
Installing collected packages: six, oauthlib, requests, requests-oauthlib, tweepy
Found existing installation: six 1.4.1
DEPRECATION: Uninstalling a distutils installed project (six) has been deprecated and will be removed in a future version. This is due to the fact that uninstalling a distutils project will only partially uninstall the project.
Uninstalling six-1.4.1:
Exception:
Traceback (most recent call last):
File "/Library/Python/2.7/site-packages/pip/basecommand.py", line 215, in main
status = self.run(options, args)
File "/Library/Python/2.7/site-packages/pip/commands/install.py", line 342, in run
prefix=options.prefix_path,
File "/Library/Python/2.7/site-packages/pip/req/req_set.py", line 778, in install
requirement.uninstall(auto_confirm=True)
File "/Library/Python/2.7/site-packages/pip/req/req_install.py", line 754, in uninstall
paths_to_remove.remove(auto_confirm)
File "/Library/Python/2.7/site-packages/pip/req/req_uninstall.py", line 115, in remove
renames(path, new_path)
File "/Library/Python/2.7/site-packages/pip/utils/__init__.py", line 267, in renames
shutil.move(old, new)
File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/shutil.py", line 302, in move
copy2(src, real_dst)
File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/shutil.py", line 131, in copy2
copystat(src, dst)
File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/shutil.py", line 103, in copystat
os.chflags(dst, st.st_flags)
OSError: [Errno 1] Operation not permitted: '/var/folders/_0/qcvk5fqn7yl39jf9g7c1bdh40000gn/T/pip-N2V_my-uninstall/System/Library/Frameworks/Python.framework/Versions/2.7/Extras/lib/python/six-1.4.1-py2.7.egg-info'
`
Unfortunately, Homebrew doesn't provide packages for python generally.
I have to say you should use pip.

Resources