Update FlowNet dependencies, codebase and CI to make it it run again on newer setups by wouterjdb · Pull Request #460 · equinor/flownet

wouterjdb · 2026-10-15T06:39:25Z

This PR is a collection of many changes to make sure FlowNet can run again in 2026.

Contributor checklist

🎉 This PR closes #ISSUE_NUMBER.
📜 I have broken down my PR into the following tasks:
- Task 1
- Task 2
🤖 I have added tests, or extended existing tests, to cover any new features or bugs fixed in this PR.
📖 I have considered adding a new entry in CHANGELOG.md.
📚 I have considered updating the documentation.

…ack (#8) * Restore FlowNet runtime compatibility * Update CI for Python 3.11 * Add bounded Egg CI smoke test * Restore Egg and Norne CI matrix * Fix README badges and Python support docs * Install CI dependencies in a virtualenv * Apply Black formatting * Fix Pylint 4 findings * Fix mypy errors in CI targets * Fix black issues * Fix remaining Pylint findings * Restore reduced CI integration coverage * Restore reduced Norne CI integration * Scope pre-push checks to committed tree * feat: add Python 3.12 compatibility * feat: target ERT 26 and Python 3.14 * fix: pass scalar cell index to grid.find_cell; fix CI heredoc indentation Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> * fix: build Webviz with fork start method on Python 3.14 Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> * fix: wrap metrics dict in DataFrame; run Webviz copy_data with fork start method Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> * Delete scripts/pre-push-checks.sh --------- Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>

* Fix docs deployment when gh-pages is missing * Remove stale pre-push hook

…e mapping, bump dependency floors (#9) Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

wouterjdb · 2026-10-15T06:40:58Z

Also updated CI, see: https://github.com/equinor/flownet

olelod · 2026-10-15T12:08:59Z

@wouterjdb You should also change the required checks in the GitHub settings to the new jobs.

Copilot

🟡 Changes recommended

Unresolved runtime regressions and duplicate deployment execution need correction before approval.

5 open findings

Prevent duplicate wheel uploads across models · New
Prevent concurrent gh-pages deployment races · New
Discover runs using configured custom runpaths · New
Ensure empty FlowNet indices use integer dtype · New
Preserve per-realization RMSE aggregation · New

What changed in this PR

Modernizes FlowNet’s reservoir-modeling workflows for current Python environments and dependencies.

Changes:

Migrates to resdata/res2df and updates ERT, pandas, and scientific-library integrations.
Updates Webviz generation, configuration handling, and compatibility tests.
Refreshes packaging, CI environments, installation instructions, and contributor documentation.

File	Description
tests/tests_multiple_one_dimensional.py	Replaces deprecated DataFrame append.
tests/test_probability_distributions.py	Renames the distribution fixture.
tests/test_iteration_analytics.py	Tests ERT parameter normalization.
tests/test_data_flow.py	Uses resdata regions.
tests/test_config_parser.py	Tests single-analysis shorthand.
tests/test_check_obsfiles_ert_yaml.py	Normalizes schedule dates.
src/flownet/utils/types.py	Adds a naming-check exemption.
src/flownet/utils/plot_results.py	Migrates summary loading to resdata.
src/flownet/utils/observations.py	Accepts ISO and legacy dates.
src/flownet/templates/webviz_pred_config.yml.jinja2	Updates the time-series plugin.
src/flownet/templates/webviz_ahm_config.yml.jinja2	Updates the time-series plugin.
src/flownet/templates/observations.ertobs.jinja2	Writes ISO observation dates.
src/flownet/templates/common_config.ert.jinja2	Updates forward-model registration.
src/flownet/static/DELETE_IN_CURRENT_ITERATION	Updates ERT executable syntax.
src/flownet/static/CREATE_FLOWNET_MODEL	Updates executable syntax and arguments.
src/flownet/realization/_simulation_realization.py	Removes extra whitespace.
src/flownet/realization/_schedule.py	Refines annotations and formatting.
src/flownet/parameters/probability_distributions.py	Updates typing and distribution validation.
src/flownet/parameters/_rock_compressibility.py	Removes extra whitespace.
src/flownet/parameters/_relative_permeability.py	Simplifies tuple assignment syntax.
src/flownet/parameters/_porv_poro_trans.py	Removes extra whitespace.
src/flownet/parameters/_permeability.py	Reformats distribution selection.
src/flownet/parameters/_fault_transmissibility.py	Removes extra whitespace.
src/flownet/parameters/_equilibration.py	Removes extra whitespace.
src/flownet/parameters/_base_parameter.py	Cleans formatting and lint suppression.
src/flownet/network_model/_one_dimensional_model.py	Returns native Python floats.
src/flownet/network_model/_network_model.py	Modernizes concatenation and fault handling.
src/flownet/network_model/_mitchell.py	Validates candidate-generation modes.
src/flownet/network_model/_hull.py	Corrects optional argument typing.
src/flownet/network_model/_generate_connections.py	Modernizes imports and table construction.
src/flownet/network_model/_create_egrid.py	Migrates grid writing to resdata.
src/flownet/hyperparameter/_run_hyper.py	Applies configuration overrides to optimization settings.
src/flownet/ert/forward_models/utils.py	Normalizes ERT parameter formats.
src/flownet/ert/forward_models/_save_predictions.py	Modernizes result concatenation.
src/flownet/ert/forward_models/_save_iteration_parameters.py	Uses parameter normalization.
src/flownet/ert/forward_models/_render_realization.py	Normalizes realization parameter inputs.
src/flownet/ert/forward_models/_iteration_analytics.py	Updates summary loading, metrics, and concatenation.
src/flownet/ert/forward_models/_flow_job.py	Supports updated ERT plugin imports.
src/flownet/ert/_run_subprocess.py	Combines subprocess output streams.
src/flownet/ert/_create_synthetic_refcase.py	Uses resdata summary-writing APIs.
src/flownet/ert/_create_ert_setup.py	Updates resampling and simulator-job setup.
src/flownet/data/perforation_strategy.py	Modernizes grouping, filling, and concatenation.
src/flownet/data/from_flow.py	Migrates readers and vectorizes volume mapping.
src/flownet/data/compdat.py	Migrates to res2df and fixes date-keyword matching.
src/flownet/config_parser/_config_transformations.py	Adjusts signature formatting.
src/flownet/config_parser/_config_parser.py	Normalizes analysis entries and validates simulation availability.
src/flownet/config_parser/_config_parser_pred.py	Corrects optional argument typing.
src/flownet/config_parser/_config_parser_hyperparam.py	Normalizes analysis entries during optimization setup.
src/flownet/ahm/_run_ahm.py	Updates regional mapping and parameter-table construction.
src/flownet/ahm/_assisted_history_matching.py	Simplifies reporting expressions.
src/flownet/_command_line.py	Adds Arrow conversion and Webviz process compatibility.
src/flownet/__init__.py	Uses standard-library package metadata.
setup.py	Updates dependencies and minimum Python version.
README.md	Refreshes installation and compatibility documentation.
pyproject.toml	Declares the build backend.
CONTRIBUTING.md	Updates local-check instructions.
CHANGELOG.md	Records modernization changes.
apt_install.sh	Updates unattended dependency installation.
.pylintrc	Adjusts lint configuration.
.pre-commit-config.yaml	Updates Black and hook stages.
.github/workflows/flownet.yml	Expands CI coverage and updates deployment steps.

🧠 Review effort: Balanced

💡 Add a code-review agent skill or configure MCP servers for context-aware, tailored reviews. Learn more in the docs.

wouterjdb · 2026-10-23T14:03:02Z

+    for data_file in output_folder.glob(
+        "output/runpath/realization-*/*/eclipse/model/*.DATA"
+    ):


@anders-kiaer, this one isn't that relevant I guess?

+        score = np.sqrt(mean_squared_error(data_reference, data_test))
    elif metric == "NRMSE":
-        score = mean_squared_error(data_reference, data_test, squared=False) / (
+        score = np.sqrt(mean_squared_error(data_reference, data_test)) / (


Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

wouterjdb · 2026-10-23T14:10:53Z

@wouterjdb You should also change the required checks in the GitHub settings to the new jobs.

@olelod

Can you be more specific?

Added condition to update GitHub pages based on test data model.

olelod · 2026-10-23T15:33:46Z

@wouterjdb You should also change the required checks in the GitHub settings to the new jobs.

@olelod

Can you be more specific?

I think maybe Anders have done it? CI was requiring running python 3.7, 3.8 and 3.9 or something like that. Now it is 3.12 and 3.14. So it's ok now.

wouterjdb and others added 18 commits October 6, 2026 20:19

Restore FlowNet runtime compatibility

84d29dc

Update CI for Python 3.11

2bceeb8

Add bounded Egg CI smoke test

5811bb8

Restore Egg and Norne CI matrix

7e3af38

Fix README badges and Python support docs

fc54027

Install CI dependencies in a virtualenv

421e170

Apply Black formatting

120fd32

Fix Pylint 4 findings

8cd47e5

Fix mypy errors in CI targets

f8ce180

Fix black issues

e315d59

Fix remaining Pylint findings

43d3044

Restore reduced CI integration coverage

febddbd

Restore reduced Norne CI integration

ea0a879

Scope pre-push checks to committed tree

0751be2

Delete scripts/pre-push-checks.sh

a476e07

Fix/initialize gh pages (#10)

20d8ed5

* Fix docs deployment when gh-pages is missing * Remove stale pre-push hook

chore: modernise pandas usage, ISO observation dates, vectorise volum…

1f8b59b

…e mapping, bump dependency floors (#9) Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

wouterjdb assigned anders-kiaer Oct 15, 2026

wouterjdb added bug Something isn't working documentation Improvements or additions to documentation enhancement New feature or request help wanted Extra attention is needed maintenance labels Oct 15, 2026

wouterjdb requested review from fahaddilib and olelod as code owners October 15, 2026 06:39

wouterjdb assigned wouterjdb and unassigned anders-kiaer Oct 15, 2026

wouterjdb requested a review from anders-kiaer October 15, 2026 06:39

olelod reviewed Oct 15, 2026

View reviewed changes

Comment thread setup.py Resolved

ci: trigger CI

3105871

anders-kiaer requested a balanced review from Copilot October 15, 2026 12:17

Copilot started reviewing on behalf of anders-kiaer October 15, 2026 12:17

View session

Copilot AI reviewed Oct 15, 2026

View reviewed changes

wouterjdb and others added 2 commits October 23, 2026 16:00

Update deployment condition for Python package

16c1080

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

Update pandas version requirement in setup.py

8166df8

wouterjdb added 2 commits October 23, 2026 16:13

Modify condition for GitHub pages update

7f6f703

Added condition to update GitHub pages based on test data model.

Fix type casting for flownet_indices in volume assignment

cd76223

Navigation Menu

Repository navigation

Update FlowNet dependencies, codebase and CI to make it it run again on newer setups - #460

Update FlowNet dependencies, codebase and CI to make it it run again on newer setups#460
wouterjdb wants to merge 23 commits into
equinor:masterfrom
wouterjdb:master

wouterjdb commented Oct 15, 2026

Uh oh!

wouterjdb commented Oct 15, 2026

Uh oh!

Uh oh!

olelod commented Oct 15, 2026

Uh oh!

Copilot AI left a comment

Uh oh!

Uh oh!

Uh oh!

wouterjdb Oct 23, 2026

Uh oh!

Uh oh!

wouterjdb commented Oct 23, 2026 •

edited

Loading

Uh oh!

olelod commented Oct 23, 2026 •

edited

Loading

Uh oh!

This branch has not been deployed

Reviewers

Uh oh!

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

Conversation

wouterjdb commented Oct 15, 2026

Contributor checklist

Uh oh!

wouterjdb commented Oct 15, 2026

Uh oh!

Uh oh!

olelod commented Oct 15, 2026

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

🟡 Changes recommended

Uh oh!

Uh oh!

Uh oh!

wouterjdb Oct 23, 2026

Choose a reason for hiding this comment

Uh oh!

Uh oh!

wouterjdb commented Oct 23, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

olelod commented Oct 23, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

This branch has not been deployed

Reviewers

Uh oh!

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

wouterjdb commented Oct 23, 2026 •

edited

Loading

olelod commented Oct 23, 2026 •

edited

Loading