Problems with updating paperless-ngs #1396

hellofaduck · 2023-05-05T06:23:09Z

hellofaduck
May 5, 2023

A clear and concise description of the issue.

I have a problem with at least 3 or 4 of the latest versions.
The raw problem looks like this:
_ Stopped Paperless-ngx

Updating to v1.14.4...
[ERROR] in line 83: exit code 1: while executing command pip install -r requirements.txt &> /dev/null`

I don't understand the root problem, some problem with OpenSSL? All packages on the system are up to date..
I understand it's not your script problem but maybe you are more experienced in that than me and can see problem quickly, thanks for the great scripts, use them in everyday work!

If relevant, including screenshots or a code block can be helpful in clarifying the issue.

So I tried to reproduce your script step by step to see more about problem:
`Collecting zxing-cpp==2.0.0 [50/326]
Using cached zxing-cpp-2.0.0.tar.gz (8.6 kB)
Installing build dependencies ... error
ERROR: Command errored out with exit status 1:
command: /usr/bin/python3 /usr/lib/python3/dist-packages/pip install --ignore-installed --no-user --pre
fix /tmp/pip-build-env-lx6h9qzw/overlay --no-warn-script-location --no-binary :none: --only-binary :none:
-i https://pypi.python.org/simple --extra-index-url https://www.piwheels.org/simple -- 'setuptools>=42' se
tuptools_scm wheel 'cmake>=3.14'
cwd: None
Complete output (59 lines):
Traceback (most recent call last):
File "/usr/lib/python3.8/runpy.py", line 194, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/usr/lib/python3.8/runpy.py", line 87, in _run_code
exec(code, run_globals)
File "/usr/lib/python3/dist-packages/pip/main.py", line 16, in
from pip._internal.cli.main import main as _main # isort:skip # noqa
File "/usr/lib/python3/dist-packages/pip/_internal/cli/main.py", line 10, in
from pip._internal.cli.autocompletion import autocomplete
File "/usr/lib/python3/dist-packages/pip/_internal/cli/autocompletion.py", line 9, in
from pip._internal.cli.main_parser import create_main_parser
File "/usr/lib/python3/dist-packages/pip/_internal/cli/main_parser.py", line 7, in
from pip._internal.cli import cmdoptions
File "/usr/lib/python3/dist-packages/pip/_internal/cli/cmdoptions.py", line 24, in
from pip._internal.exceptions import CommandError
File "/usr/lib/python3/dist-packages/pip/_internal/exceptions.py", line 10, in
from pip._vendor.six import iteritems
File "/usr/lib/python3/dist-packages/pip/_vendor/init.py", line 65, in
vendored("cachecontrol")
File "/usr/lib/python3/dist-packages/pip/_vendor/init.py", line 36, in vendored
import(modulename, globals(), locals(), level=0)
import(modulename, globals(), locals(), level=0)
File "", line 991, in _find_and_load
File "", line 975, in _find_and_load_unlocked
File "", line 655, in _load_unlocked
File "", line 618, in _load_backward_compatible
File "", line 259, in load_module
File "/usr/share/python-wheels/CacheControl-0.12.6-py2.py3-none-any.whl/cachecontrol/init.py", lin
e 9, in

File "<frozen importlib._bootstrap>", line 991, in _find_and_load
File "<frozen importlib._bootstrap>", line 975, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 655, in _load_unlocked
File "<frozen importlib._bootstrap>", line 618, in _load_backward_compatible
File "<frozen zipimport>", line 259, in load_module
File "/usr/share/python-wheels/CacheControl-0.12.6-py2.py3-none-any.whl/cachecontrol/wrapper.py", line

1, in
File "", line 991, in _find_and_load
File "", line 975, in _find_and_load_unlocked
File "", line 655, in _load_unlocked
File "", line 618, in _load_backward_compatible
File "", line 259, in load_module
File "/usr/share/python-wheels/CacheControl-0.12.6-py2.py3-none-any.whl/cachecontrol/adapter.py", line
5, in
File "", line 991, in _find_and_load
File "", line 975, in _find_and_load_unlocked
File "", line 655, in _load_unlocked
File "", line 618, in _load_backward_compatible
File "", line 259, in load_module
File "/usr/share/python-wheels/urllib3-1.25.8-py2.py3-none-any.whl/urllib3/contrib/pyopenssl.py", line 46, in
File "/usr/local/lib/python3.8/dist-packages/OpenSSL/init.py", line 8, in
from OpenSSL import SSL, crypto
File "/usr/local/lib/python3.8/dist-packages/OpenSSL/SSL.py", line 19, in
from OpenSSL.crypto import (
File "/usr/local/lib/python3.8/dist-packages/OpenSSL/crypto.py", line 3253, in
utils.deprecated(
TypeError: deprecated() got an unexpected keyword argument 'name'

ERROR: Command errored out with exit status 1: /usr/bin/python3 /usr/lib/python3/dist-packages/pip install --ignore-installed --no-user --prefix /tmp/pip-build-env-lx6h9qzw/overlay --no-warn-script-location --no-binary :none: --only-binary :none: -i https://pypi.python.org/simple --extra-index-url https://www.piwheels.org/simple -- 'setuptools>=42' setuptools_scm wheel 'cmake>=3.14' Check the logs for full command output.

Please provide detailed steps to reproduce the issue.

Just run the script to update

Answered by tteck

Sep 24, 2023

Ensure you have the latest versions of pip and setuptools installed:

pip install --upgrade pip setuptools

Ensure that you have sufficient system resources (memory and disk space) to install the required packages.

View full answer

tteck · 2023-05-05T12:49:08Z

tteck
May 5, 2023
Maintainer

It does not pose a problem for me.

    ____                        __                                     
   / __ \____ _____  ___  _____/ /__  __________    ____  ____ __  __
  / /_/ / __ `/ __ \/ _ \/ ___/ / _ \/ ___/ ___/___/ __ \/ __ `/ |/_/
 / ____/ /_/ / /_/ /  __/ /  / /  __(__  |__  )___/ / / / /_/ />  <  
/_/    \__,_/ .___/\___/_/  /_/\___/____/____/   /_/ /_/\__, /_/|_|  
           /_/                                         /____/        
 
 ✓ Stopped Paperless-ngx
 ✓ paperless-task-queue.service Exists.
 ✓ Updated to v1.14.4
 ✓ Cleaned
 ✓ Started Paperless-ngx
 ✓ Updated Successfully!

root@paperless-ngx:~#

Moving to discussions

0 replies

hellofaduck · 2023-05-05T15:04:34Z

hellofaduck
May 5, 2023
Author

Strange, but googling and
pip uninstall pyOpenSSL
helps to solve this problem...

0 replies

ChrisGoudt · 2023-09-24T01:26:57Z

ChrisGoudt
Sep 24, 2023

4 replies

tteck Sep 24, 2023
Maintainer

Ensure you have the latest versions of pip and setuptools installed:

pip install --upgrade pip setuptools

Ensure that you have sufficient system resources (memory and disk space) to install the required packages.

Answer selected by tteck

ChrisGoudt Sep 24, 2023

Thanks, that fixed it!

ChrisGoudt Sep 24, 2023

oops, deleted the original post by accident... for reference

netSpeedyTV Sep 28, 2023

i have the same problem "pip install --upgrade pip setuptools" not helps

hellofaduck · 2023-09-24T10:23:58Z

hellofaduck
Sep 24, 2023
Author

In my case this fix the problem:
apt install pkg-config

1 reply

tteck Sep 24, 2023
Maintainer

pkg-config is a command-line tool to retrieve information about installed libraries and their corresponding compiler and linker flags. But, whatever works.

hellofaduck · 2023-09-24T10:39:01Z

hellofaduck
Sep 24, 2023
Author

In my cace pip can't install mysql component because of some pkg-config problem...

0 replies

Frontholz · 2024-01-28T17:52:57Z

Frontholz
Jan 28, 2024

I've got the same error here after updating debian to bookworm. I've tried the suggested solution:

` pip install --upgrade pip setuptools
error: externally-managed-environment

× This environment is externally managed
╰─> To install Python packages system-wide, try apt install
python3-xyz, where xyz is the package you are trying to
install.
`

apt tells me, that the installed version is the actual on
@paperless-ngx:~# apt install python3-setuptools Reading package lists... Done Building dependency tree... Done Reading state information... Done python3-setuptools is already the newest version (66.1.1-1). 0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded.

@paperless-ngx:~# uname -a Linux paperless-ngx 6.5.11-7-pve #1 SMP PREEMPT_DYNAMIC PMX 6.5.11-7 (2023-12-05T09:44Z) x86_64 GNU/Linux

Of course, paperless is not starting at all...

Someone out there with a solution?

2 replies

tteck Jan 28, 2024
Maintainer

Did you follow these instructions to update to Debian 12? #1498

Frontholz Jan 28, 2024

Upps, not seen it before... :\

But followed it now and everything is up and working again!
Thanks for the great work - you saved my day!

zelig2 · 2024-05-15T20:41:37Z

zelig2
May 15, 2024

I'm also having a similar problem. I tried upgrading pip and setuptools as stated above but they didn't need updating.

When running the update script for paperless-ngx I get the error during the migrate process. I updated django but that did not change the output of the error. It seems like I need to migrate the database encoding from SQL_ASCII to UTF8 to fix this issue.

uname -a Linux paperless-ngx 6.2.16-19-pve #1 SMP PREEMPT_DYNAMIC PMX 6.2.16-19 (2023-10-24T12:07Z) x86_64 GNU/Linux

/etc/debian_version  12.5

I manually ran each line of the upgrade script to determine where the failure occurred.

   ____                        __                                     
   / __ \____ _____  ___  _____/ /__  __________    ____  ____ __  __
  / /_/ / __ `/ __ \/ _ \/ ___/ / _ \/ ___/ ___/___/ __ \/ __ `/ |/_/
 / ____/ /_/ / /_/ /  __/ /  / /  __(__  |__  )___/ / / / /_/ />  <  
/_/    \__,_/ .___/\___/_/  /_/\___/____/____/   /_/ /_/\__, /_/|_|  
           /_/                                         /____/        
 
cat: /opt/Paperless-ngx_version.txt: No such file or directory
 ✓ Stopped all Paperless-ngx Services
 \ Updating to v2.8.4   
[ERROR] in line 83: exit code 0: while executing command /usr/bin/python3 manage.py migrate &> /dev/null

root@paperless-ngx:~#   RELEASE=$(curl -s https://api.github.com/repos/paperless-ngx/paperless-ngx/releases/latest | grep "tag_name" | awk '{print substr($2, 2, length($2)-3) }')
root@paperless-ngx:~# echo $RELEASE
v2.8.4
root@paperless-ngx:~# systemctl stop paperless-consumer paperless-webserver paperless-scheduler paperless-task-queue.service
root@paperless-ngx:~# wget -q https://github.com/paperless-ngx/paperless-ngx/releases/download/$RELEASE/paperless-ngx-$RELEASE.tar.xz
      tar -xf paperless-ngx-$RELEASE.tar.xz
      cp -r /opt/paperless/paperless.conf paperless-ngx/
      cp -r paperless-ngx/* /opt/paperless/
      cd /opt/paperless
      pip install -r requirements.txt &>/dev/null
      cd /opt/paperless/src
root@paperless-ngx:/opt/paperless/src# /usr/bin/python3 manage.py migrate
Operations to perform:
  Apply all migrations: account, admin, auditlog, auth, authtoken, contenttypes, django_celery_results, documents, guardian, paperless, paperless_mail, sessions, socialaccount
Running migrations:
  Applying auditlog.0015_alter_logentry_changes...Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/django/db/backends/utils.py", line 87, in _execute
    return self.cursor.execute(sql)
           ^^^^^^^^^^^^^^^^^^^^^^^^
psycopg2.errors.FeatureNotSupported: conversion between UTF8 and SQL_ASCII is not supported


The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/opt/paperless/src/manage.py", line 10, in <module>
    execute_from_command_line(sys.argv)
  File "/usr/local/lib/python3.11/dist-packages/django/core/management/__init__.py", line 442, in execute_from_command_line
    utility.execute()
  File "/usr/local/lib/python3.11/dist-packages/django/core/management/__init__.py", line 436, in execute
    self.fetch_command(subcommand).run_from_argv(self.argv)
  File "/usr/local/lib/python3.11/dist-packages/django/core/management/base.py", line 412, in run_from_argv
    self.execute(*args, **cmd_options)
  File "/usr/local/lib/python3.11/dist-packages/django/core/management/base.py", line 458, in execute
    output = self.handle(*args, **options)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/django/core/management/base.py", line 106, in wrapper
    res = handle_func(*args, **kwargs)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/django/core/management/commands/migrate.py", line 356, in handle
    post_migrate_state = executor.migrate(
                         ^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/django/db/migrations/executor.py", line 135, in migrate
    state = self._migrate_all_forwards(
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/django/db/migrations/executor.py", line 167, in _migrate_all_forwards
    state = self.apply_migration(
            ^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/django/db/migrations/executor.py", line 252, in apply_migration
    state = migration.apply(state, schema_editor)
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/django/db/migrations/migration.py", line 132, in apply
    operation.database_forwards(
  File "/usr/local/lib/python3.11/dist-packages/django/db/migrations/operations/fields.py", line 235, in database_forwards
    schema_editor.alter_field(from_model, from_field, to_field)
  File "/usr/local/lib/python3.11/dist-packages/django/db/backends/base/schema.py", line 831, in alter_field
    self._alter_field(
  File "/usr/local/lib/python3.11/dist-packages/django/db/backends/postgresql/schema.py", line 288, in _alter_field
    super()._alter_field(
  File "/usr/local/lib/python3.11/dist-packages/django/db/backends/base/schema.py", line 1056, in _alter_field
    self.execute(
  File "/usr/local/lib/python3.11/dist-packages/django/db/backends/postgresql/schema.py", line 48, in execute
    return super().execute(sql, None)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/django/db/backends/base/schema.py", line 201, in execute
    cursor.execute(sql, params)
  File "/usr/local/lib/python3.11/dist-packages/django/db/backends/utils.py", line 67, in execute
    return self._execute_with_wrappers(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/django/db/backends/utils.py", line 80, in _execute_with_wrappers
    return executor(sql, params, many, context)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/django/db/backends/utils.py", line 84, in _execute
    with self.db.wrap_database_errors:
  File "/usr/local/lib/python3.11/dist-packages/django/db/utils.py", line 91, in __exit__
    raise dj_exc_value.with_traceback(traceback) from exc_value
  File "/usr/local/lib/python3.11/dist-packages/django/db/backends/utils.py", line 87, in _execute
    return self.cursor.execute(sql)
           ^^^^^^^^^^^^^^^^^^^^^^^^
django.db.utils.NotSupportedError: conversion between UTF8 and SQL_ASCII is not supported

3 replies

tteck May 15, 2024
Maintainer

#2925 (comment)

Toxo666 May 16, 2024

Check out these links, you will find a solution:

https://www.bytehero.io/posts/2024/paperless-postgres-encoding-error/
https://stackoverflow.com/questions/16736891/pgerror-error-new-encoding-utf8-is-incompatible/16737776#16737776

For the second link, please note the comment below the post (step 0 for Debian).
It worked wonderfully.

zelig2 May 17, 2024

@Toxo666 Thanks for these links. This worked perfectly for my installation and now I'm on the latest release.

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Problems with updating paperless-ngs #1396

{{title}}

Replies: 7 comments 10 replies

{{title}}

{{title}}

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

Select a reply

Problems with updating paperless-ngs #1396

A clear and concise description of the issue.

If relevant, including screenshots or a code block can be helpful in clarifying the issue.

Please provide detailed steps to reproduce the issue.

Replies: 7 comments · 10 replies

tteck May 5, 2023 Maintainer

hellofaduck May 5, 2023 Author

tteck Sep 24, 2023 Maintainer

hellofaduck Sep 24, 2023 Author

tteck Sep 24, 2023 Maintainer

hellofaduck Sep 24, 2023 Author

tteck Jan 28, 2024 Maintainer

tteck May 15, 2024 Maintainer

Replies: 7 comments 10 replies

tteck
May 5, 2023
Maintainer

hellofaduck
May 5, 2023
Author

tteck Sep 24, 2023
Maintainer

hellofaduck
Sep 24, 2023
Author

tteck Sep 24, 2023
Maintainer

hellofaduck
Sep 24, 2023
Author

tteck Jan 28, 2024
Maintainer

tteck May 15, 2024
Maintainer