ArchiveBox v0.9 is now released

[SpaceAgeHero]

Hi guys,

just a heads up: https://github.com/ArchiveBox/ArchiveBox/releases/tag/v0.9.50

Helper-Script seems to be hardcoded to install v0.7.4?

[MickLesk]

Its Not pinned, it Install the latest pushed UV package.

$STD uv pip install archivebox --system --break-system-packages

[SpaceAgeHero]

root@archivebox:~# uv pip install --system --break-system-packages --upgrade 'archivebox==0.9.51'
Using Python 3.11.2 environment at: /usr
error: No solution found when resolving dependencies
cause: Because the current Python version (3.11.2) does not satisfy Python>=3.13 and archivebox==0.9.51 depends on
Python>=3.13, we can conclude that archivebox==0.9.51 cannot be used.
And because only archivebox<=0.9.51 is available and you require archivebox==0.9.51, we can conclude that your
requirements are unsatisfiable.

[MickLesk]

Can you test it? Check the PR and put the Commands in your LXC;
#17495

Backup first please

[SpaceAgeHero]

I set up a new LXC with v0.7.4 and added some links to archive.
After that I successfully upgraded with the fix and can reach the web UI, however after that I cannot access my existing content:

Also new crawls don't work:

/opt/archivebox/data/logs/errors.log:

/home/archivebox/.config/abx/lib/env/bin/archivebox run --daemon; TS=2026-09-25__18:07:58 VERSION=0.9.51 IN_DOCKER=False IS_TTY=False
abxbus.retry _install_or_find failed after 1 attempts over 1.7s. Semaphore wait: 0.1s. Final error: BinaryInstallError: Unable to install binary postlight-parser via providers env, npm. ERRORS={'npm': 'NpmProvider install failed for ('@postlight/parser@2.2.3',) with returncode 1\nnpm error code EALLOWGIT\nnpm error Fetching packages of type "git" have been disabled\nnpm error Refusing to fetch "difflib@github:postlight/difflib.js"\nnpm error A complete log of this run can be found in: ~/.config/abx/lib/cache/npm/_logs/2026-09-25T18_08_01_569Z-debug-0.log'}

/home/archivebox/.config/abx/lib/env/bin/archivebox run --daemon; TS=2026-09-25__18:08:04 VERSION=0.9.51 IN_DOCKER=False IS_TTY=False
abxbus.retry _install_or_find failed after 1 attempts over 1.6s. Semaphore wait: 0.1s. Final error: BinaryInstallError: Unable to install binary postlight-parser via providers env, npm. ERRORS={'npm': 'NpmProvider install failed for ('@postlight/parser@2.2.3',) with returncode 1\nnpm error code EALLOWGIT\nnpm error Fetching packages of type "git" have been disabled\nnpm error Refusing to fetch "difflib@github:postlight/difflib.js"\nnpm error A complete log of this run can be found in: ~/.config/abx/lib/cache/npm/_logs/2026-09-25T18_08_07_910Z-debug-0.log'}

/home/archivebox/.config/abx/lib/env/bin/archivebox run --daemon; TS=2026-09-25__18:08:10 VERSION=0.9.51 IN_DOCKER=False IS_TTY=False
abxbus.retry _install_or_find failed after 1 attempts over 1.7s. Semaphore wait: 0.1s. Final error: BinaryInstallError: Unable to install binary postlight-parser via providers env, npm. ERRORS={'npm': 'NpmProvider install failed for ('@postlight/parser@2.2.3',) with returncode 1\nnpm error code EALLOWGIT\nnpm error Fetching packages of type "git" have been disabled\nnpm error Refusing to fetch "difflib@github:postlight/difflib.js"\nnpm error A complete log of this run can be found in: ~/.config/abx/lib/cache/npm/_logs/2026-09-25T18_08_14_243Z-debug-0.log'}

/home/archivebox/.config/abx/lib/env/bin/archivebox run --daemon; TS=2026-09-25__18:08:17 VERSION=0.9.51 IN_DOCKER=False IS_TTY=False
root@archivebox:/opt/archivebox/data/logs# tail errors.log
/home/archivebox/.config/abx/lib/env/bin/archivebox run --daemon; TS=2026-09-25__18:08:17 VERSION=0.9.51 IN_DOCKER=False IS_TTY=False
abxbus.retry _install_or_find failed after 1 attempts over 1.7s. Semaphore wait: 0.1s. Final error: BinaryInstallError: Unable to install binary postlight-parser via providers env, npm. ERRORS={'npm': 'NpmProvider install failed for ('@postlight/parser@2.2.3',) with returncode 1\nnpm error code EALLOWGIT\nnpm error Fetching packages of type "git" have been disabled\nnpm error Refusing to fetch "difflib@github:postlight/difflib.js"\nnpm error A complete log of this run can be found in: ~/.config/abx/lib/cache/npm/_logs/2026-09-25T18_08_20_506Z-debug-0.log'}

/home/archivebox/.config/abx/lib/env/bin/archivebox run --daemon; TS=2026-09-25__18:08:23 VERSION=0.9.51 IN_DOCKER=False IS_TTY=False
abxbus.retry _install_or_find failed after 1 attempts over 1.6s. Semaphore wait: 0.1s. Final error: BinaryInstallError: Unable to install binary postlight-parser via providers env, npm. ERRORS={'npm': 'NpmProvider install failed for ('@postlight/parser@2.2.3',) with returncode 1\nnpm error code EALLOWGIT\nnpm error Fetching packages of type "git" have been disabled\nnpm error Refusing to fetch "difflib@github:postlight/difflib.js"\nnpm error A complete log of this run can be found in: ~/.config/abx/lib/cache/npm/_logs/2026-09-25T18_08_26_806Z-debug-0.log'}

/home/archivebox/.config/abx/lib/env/bin/archivebox run --daemon; TS=2026-09-25__18:08:29 VERSION=0.9.51 IN_DOCKER=False IS_TTY=False
abxbus.retry _install_or_find failed after 1 attempts over 1.6s. Semaphore wait: 0.1s. Final error: BinaryInstallError: Unable to install binary postlight-parser via providers env, npm. ERRORS={'npm': 'NpmProvider install failed for ('@postlight/parser@2.2.3',) with returncode 1\nnpm error code EALLOWGIT\nnpm error Fetching packages of type "git" have been disabled\nnpm error Refusing to fetch "difflib@github:postlight/difflib.js"\nnpm error A complete log of this run can be found in: ~/.config/abx/lib/cache/npm/_logs/2026-09-25T18_08_33_151Z-debug-0.log'}

Sorry, I'm not sure how to get more helpful information, as I was planning to deploy as new user with brand new version. :-(

Let me know which logs, paths, permissions to check.

[SpaceAgeHero]

New deployment fails:

Installing ArchiveBoxsend: spawn id exp5 not open
while executing
"send "\r""
✖️ in line 51: exit code 1 (General error / Operation not permitted): while executing command expect <<EOF
set timeout -1
log_user 0

spawn sudo -u archivebox playwright install chromium
spawn sudo -u archivebox archivebox setup

expect "Username"
"end "

expect "Email address"
"end "

expect "Password"
"end "community-scripts.org

expect "Password (again)"
"end "community-scripts.org

expect eof
EOF

--- Last 20 lines of log ---
set timeout -1
log_user 0

spawn sudo -u archivebox playwright install chromium
spawn sudo -u archivebox archivebox setup

expect "Username"
"end "

expect "Email address"
"end "

expect "Password"
"end "community-scripts.org

expect "Password (again)"
"end "community-scripts.org

expect eof
EOF

✖️ Installation failed in container 124 (exit code: 1)
📋 Installation log: /tmp/archivebox-124-58aaf7ba.log

Error: General error / Operation not permitted

[SpaceAgeHero]

This made previous snapshots available again:

cd /opt/archivebox/data/
archivebox init
archivebox update --rescan --migrate-only --index-only
archivebox status

(Still trying to fix iframe connection issues, even though base URL is set)

root@archivebox:/opt/archivebox/data# archivebox version reveals

Error: Failed to detect the following binaries:
postlight-parser, papers-dl, feedparser, readability-extractor, singlefile, trafilatura, twocaptcha, ublock

Hint: To install missing binaries automatically, run:
archivebox install

archivebox install falls on its face:

retry.py:534
install:postlight-parser failed - 0.0s/300s Unable to install binary postlight-parser via provi…
Traceback (most recent call last):
File "/opt/archivebox/venv/lib/python3.13/site-packages/abxpkg/binary.py", line 322, in install
installed_bin = provider.install(
self.name,
...<7 lines>...
min_version=self.min_version,
)
File "/opt/archivebox/venv/lib/python3.13/site-packages/abxpkg/binprovider.py", line 149, in locked
return method(self, *args, **kwargs)
File "/opt/archivebox/venv/lib/python3.13/site-packages/abxpkg/logging.py", line 698, in wrapper
result = func(*args, **kwargs)
File "/opt/archivebox/venv/lib/python3.13/site-packages/pydantic/_internal/_validate_call.py", line 40, in wrapper_function
return wrapper(*args, **kwargs)
File "/opt/archivebox/venv/lib/python3.13/site-packages/pydantic/_internal/_validate_call.py", line 137, in call
res = self.pydantic_validator.validate_python(pydantic_core.ArgsKwargs(args, kwargs))
File "/opt/archivebox/venv/lib/python3.13/site-packages/abxpkg/binprovider.py", line 3414, in install
self._call_handler_for_action(
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^
bin_name=bin_name,
^^^^^^^^^^^^^^^^^^
...<7 lines>...
timeout=self.install_timeout,
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
),
^
File "/opt/archivebox/venv/lib/python3.13/site-packages/abxpkg/logging.py", line 698, in wrapper
result = func(*args, **kwargs)
File "/opt/archivebox/venv/lib/python3.13/site-packages/abxpkg/binprovider.py", line 2188, in _call_handler_for_action
return handler_func(bin_name, **compatible_kwargs)
File "/opt/archivebox/venv/lib/python3.13/site-packages/abxpkg/binprovider.py", line 250, in wrapper
return func(*args, **mapped_kwargs)
File "/opt/archivebox/venv/lib/python3.13/site-packages/abxpkg/binprovider_npm.py", line 571, in default_install_handler
self._raise_proc_error("install", install_args, proc)
~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/archivebox/venv/lib/python3.13/site-packages/abxpkg/binprovider.py", line 2734, in _raise_proc_error
raise exc_cls(
...<4 lines>...
)
abxpkg.exceptions.BinProviderInstallError: NpmProvider install failed for ('@postlight/parser@2.2.3',) with returncode 1
npm error code EALLOWGIT
npm error Fetching packages of type "git" have been disabled
npm error Refusing to fetch "difflib@github:postlight/difflib.js"
npm error A complete log of this run can be found in: /home/archivebox/.config/abx/lib/cache/npm/_logs/2026-09-26T05_49_22_946Z-debug-0.log

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/usr/local/bin/archivebox", line 10, in
sys.exit(main())
~~~~^^
File "/opt/archivebox/venv/lib/python3.13/site-packages/archivebox/cli/init.py", line 207, in main
cli(args=args, prog_name=prog_name, standalone_mode=False)
~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/archivebox/venv/lib/python3.13/site-packages/click/core.py", line 1631, in call
return self.main(*args, **kwargs)
~~~~~~~~~^^^^^^^^^^^^^^^^^
File "/opt/archivebox/venv/lib/python3.13/site-packages/click/core.py", line 1552, in main
rv = self.invoke(ctx)
File "/opt/archivebox/venv/lib/python3.13/site-packages/click/core.py", line 2032, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^
File "/opt/archivebox/venv/lib/python3.13/site-packages/click/core.py", line 1415, in invoke
return ctx.invoke(self.callback, **ctx.params)
~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/archivebox/venv/lib/python3.13/site-packages/click/core.py", line 910, in invoke
return callback(*args, **kwargs)
File "/opt/archivebox/venv/lib/python3.13/site-packages/archivebox/cli/archivebox_install.py", line 225, in main
install(**kwargs)
~~~~~~~^^^^^^^^^^
File "/opt/archivebox/venv/lib/python3.13/site-packages/archivebox/misc/util.py", line 364, in typechecked_function
return func(*args, **kwargs)
File "/opt/archivebox/venv/lib/python3.13/site-packages/archivebox/cli/archivebox_install.py", line 179, in install
run_install(plugin_names=install_plugin_names or None)
~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/archivebox/venv/lib/python3.13/site-packages/archivebox/services/runner.py", line 1768, in run_install
asyncio.run(_run_install(plugin_names=plugin_names))
~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/archivebox/python/cpython-3.13.15-linux-x86_64-gnu/lib/python3.13/asyncio/runners.py", line 196, in run
return runner.run(main)
~~~~~~~~~~^^^^^^
File "/opt/archivebox/python/cpython-3.13.15-linux-x86_64-gnu/lib/python3.13/asyncio/runners.py", line 119, in run
return self._loop.run_until_complete(task)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^
File "/opt/archivebox/python/cpython-3.13.15-linux-x86_64-gnu/lib/python3.13/asyncio/base_events.py", line 726, in run_until_complete
return future.result()
~~~~~~~~~~~~~^^
File "/opt/archivebox/venv/lib/python3.13/site-packages/archivebox/services/runner.py", line 1750, in _run_install
await install_event.event_results_list()
File "/opt/archivebox/venv/lib/python3.13/site-packages/abxbus/base_event.py", line 1593, in event_results_list
raise single_error
File "/opt/archivebox/venv/lib/python3.13/site-packages/abxbus/base_event.py", line 724, in run_handler
handler_return_value = await self._call_handler(
^^^^^^^^^^^^^^^^^^^^^^^^^
...<3 lines>...
)
^
File "/opt/archivebox/venv/lib/python3.13/site-packages/abxbus/helpers.py", line 87, in cancel_and_await
await run_with_timeout(task, timeout=timeout)
File "/opt/archivebox/venv/lib/python3.13/site-packages/abxbus/helpers.py", line 77, in run_with_timeout
return await asyncio.wait_for(awaitable, timeout=timeout)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/archivebox/python/cpython-3.13.15-linux-x86_64-gnu/lib/python3.13/asyncio/tasks.py", line 507, in wait_for
return await fut
^^^^^^^^^
File "/opt/archivebox/venv/lib/python3.13/site-packages/abx_dl/services/binary_service.py", line 193, in on_InstallEvent
await completed_request.event_results_list(raise_if_none=False)
File "/opt/archivebox/venv/lib/python3.13/site-packages/abxbus/base_event.py", line 1593, in event_results_list
raise single_error
File "/opt/archivebox/venv/lib/python3.13/site-packages/abxbus/base_event.py", line 724, in run_handler
handler_return_value = await self._call_handler(
^^^^^^^^^^^^^^^^^^^^^^^^^
...<3 lines>...
)
^
File "/opt/archivebox/venv/lib/python3.13/site-packages/abxbus/helpers.py", line 87, in cancel_and_await
await run_with_timeout(task, timeout=timeout)
File "/opt/archivebox/venv/lib/python3.13/site-packages/abxbus/helpers.py", line 77, in run_with_timeout
return await asyncio.wait_for(awaitable, timeout=timeout)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/archivebox/python/cpython-3.13.15-linux-x86_64-gnu/lib/python3.13/asyncio/tasks.py", line 507, in wait_for
return await fut
^^^^^^^^^
File "/opt/archivebox/venv/lib/python3.13/site-packages/abxpkg/binary_service.py", line 522, in on_BinaryRequestEvent
installed = await self._install_or_find(event)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/archivebox/venv/lib/python3.13/site-packages/abxbus/retry.py", line 867, in async_wrapper
return await _execute_with_retries(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
...<11 lines>...
)
^
File "/opt/archivebox/venv/lib/python3.13/site-packages/abxbus/retry.py", line 510, in _execute_with_retries
return await func_runner(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/archivebox/venv/lib/python3.13/site-packages/abxpkg/binary_service.py", line 618, in _install_or_find
return await asyncio.to_thread(
^^^^^^^^^^^^^^^^^^^^^^^^
...<5 lines>...
)
^
File "/opt/archivebox/python/cpython-3.13.15-linux-x86_64-gnu/lib/python3.13/asyncio/threads.py", line 26, in to_thread
return await loop.run_in_executor(None, func_call)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/archivebox/python/cpython-3.13.15-linux-x86_64-gnu/lib/python3.13/concurrent/futures/thread.py", line 59, in run
result = self.fn(*self.args, **self.kwargs)
File "/opt/archivebox/venv/lib/python3.13/site-packages/pydantic/_internal/_validate_call.py", line 40, in wrapper_function
return wrapper(*args, **kwargs)
File "/opt/archivebox/venv/lib/python3.13/site-packages/pydantic/_internal/_validate_call.py", line 137, in call
res = self.pydantic_validator.validate_python(pydantic_core.ArgsKwargs(args, kwargs))
File "/opt/archivebox/venv/lib/python3.13/site-packages/abxpkg/logging.py", line 698, in wrapper
result = func(*args, **kwargs)
File "/opt/archivebox/venv/lib/python3.13/site-packages/abxpkg/binary.py", line 361, in install
raise BinaryInstallError(self.name, provider_names, errors) from inner_exc
abxpkg.exceptions.BinaryInstallError: Unable to install binary postlight-parser via providers env, npm. ERRORS={'npm': 'NpmProvider install failed for ('@postlight/parser@2.2.3',) with returncode 1\nnpm error code EALLOWGIT\nnpm error Fetching packages of type "git" have been disabled\nnpm error Refusing to fetch "difflib@github:postlight/difflib.js"\nnpm error A complete log of this run can be found in: ~/.config/abx/lib/cache/npm/_logs/2026-09-26T05_49_22_946Z-debug-0.log'}

[MickLesk]

Maybe i release it as Breaking Change to recreate the whole Container. I dont have it, so i cant reproduce all.

[SpaceAgeHero]

Fine for me, there are years of changes between these versions.