Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore: merge develop into master #167

Open
wants to merge 51 commits into
base: master
Choose a base branch
from
Open

chore: merge develop into master #167

wants to merge 51 commits into from

Conversation

nortaljevgenikr
Copy link
Contributor

Refs: OPMONDEV-190

melbeltagy and others added 30 commits September 20, 2024 14:17
chore: Merge master commits into develop
chore: Update dependencies to latest versions compatible with python 3.8

Refs: OPMONDEV-187
… timeout

Corrector marks documents as orphans if either the client or producer part is missing after the configured amount of time.

But sometimes the second part of the metrics arrives after the document was marked as "done". In that case, the corrector incorrectly adds a second document for the same "xRequestId" value into clean data.

This commit addresses this issue by updating the existing document instead of adding a duplicate.

The value of "correctorTime" however is not updated to avoid the anonymizer from processing the updated document again and inserting a duplicate into opendata.
…py3.9

chore: Ignore dependencies that require python >= 3.9 from dependabot
…ith 3 updates

Bumps the python-minor-patch group with 3 updates in the /anonymizer_module directory: [setuptools](https://github.com/pypa/setuptools), [pymongo](https://github.com/mongodb/mongo-python-driver) and [psycopg2](https://github.com/psycopg/psycopg2).
Bumps the python-minor-patch group with 2 updates in the /collector_module directory: [setuptools](https://github.com/pypa/setuptools) and [pymongo](https://github.com/mongodb/mongo-python-driver).
Bumps the python-minor-patch group with 2 updates in the /corrector_module directory: [setuptools](https://github.com/pypa/setuptools) and [pymongo](https://github.com/mongodb/mongo-python-driver).
Bumps the python-minor-patch group with 3 updates in the /opendata_module directory: [setuptools](https://github.com/pypa/setuptools), [pymongo](https://github.com/mongodb/mongo-python-driver) and [psycopg2](https://github.com/psycopg/psycopg2).
Bumps the python-minor-patch group with 1 update in the /reports_module directory: [pymongo](https://github.com/mongodb/mongo-python-driver).


Updates `setuptools` from 75.1.0 to 75.2.0
- [Release notes](https://github.com/pypa/setuptools/releases)
- [Changelog](https://github.com/pypa/setuptools/blob/main/NEWS.rst)
- [Commits](pypa/setuptools@v75.1.0...v75.2.0)

Updates `pymongo` from 4.9.1 to 4.10.1
- [Release notes](https://github.com/mongodb/mongo-python-driver/releases)
- [Changelog](https://github.com/mongodb/mongo-python-driver/blob/master/doc/changelog.rst)
- [Commits](mongodb/mongo-python-driver@4.9.1...4.10.1)

Updates `psycopg2` from 2.9.9 to 2.9.10
- [Changelog](https://github.com/psycopg/psycopg2/blob/master/NEWS)
- [Commits](https://github.com/psycopg/psycopg2/commits)

Updates `setuptools` from 75.1.0 to 75.2.0
- [Release notes](https://github.com/pypa/setuptools/releases)
- [Changelog](https://github.com/pypa/setuptools/blob/main/NEWS.rst)
- [Commits](pypa/setuptools@v75.1.0...v75.2.0)

Updates `pymongo` from 4.9.1 to 4.10.1
- [Release notes](https://github.com/mongodb/mongo-python-driver/releases)
- [Changelog](https://github.com/mongodb/mongo-python-driver/blob/master/doc/changelog.rst)
- [Commits](mongodb/mongo-python-driver@4.9.1...4.10.1)

Updates `setuptools` from 75.1.0 to 75.2.0
- [Release notes](https://github.com/pypa/setuptools/releases)
- [Changelog](https://github.com/pypa/setuptools/blob/main/NEWS.rst)
- [Commits](pypa/setuptools@v75.1.0...v75.2.0)

Updates `pymongo` from 4.9.1 to 4.10.1
- [Release notes](https://github.com/mongodb/mongo-python-driver/releases)
- [Changelog](https://github.com/mongodb/mongo-python-driver/blob/master/doc/changelog.rst)
- [Commits](mongodb/mongo-python-driver@4.9.1...4.10.1)

Updates `setuptools` from 75.1.0 to 75.2.0
- [Release notes](https://github.com/pypa/setuptools/releases)
- [Changelog](https://github.com/pypa/setuptools/blob/main/NEWS.rst)
- [Commits](pypa/setuptools@v75.1.0...v75.2.0)

Updates `pymongo` from 4.9.1 to 4.10.1
- [Release notes](https://github.com/mongodb/mongo-python-driver/releases)
- [Changelog](https://github.com/mongodb/mongo-python-driver/blob/master/doc/changelog.rst)
- [Commits](mongodb/mongo-python-driver@4.9.1...4.10.1)

Updates `psycopg2` from 2.9.9 to 2.9.10
- [Changelog](https://github.com/psycopg/psycopg2/blob/master/NEWS)
- [Commits](https://github.com/psycopg/psycopg2/commits)

Updates `pymongo` from 4.9.1 to 4.10.1
- [Release notes](https://github.com/mongodb/mongo-python-driver/releases)
- [Changelog](https://github.com/mongodb/mongo-python-driver/blob/master/doc/changelog.rst)
- [Commits](mongodb/mongo-python-driver@4.9.1...4.10.1)

---
updated-dependencies:
- dependency-name: setuptools
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: python-minor-patch
- dependency-name: pymongo
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: python-minor-patch
- dependency-name: psycopg2
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: python-minor-patch
- dependency-name: setuptools
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: python-minor-patch
- dependency-name: pymongo
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: python-minor-patch
- dependency-name: setuptools
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: python-minor-patch
- dependency-name: pymongo
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: python-minor-patch
- dependency-name: setuptools
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: python-minor-patch
- dependency-name: pymongo
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: python-minor-patch
- dependency-name: psycopg2
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: python-minor-patch
- dependency-name: pymongo
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: python-minor-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
…py3.9-part2

chore: Ignore dependencies that require python >= 3.9 from dependabot
…py3.9-part3

chore: Ignore dependencies that require python >= 3.9 from dependabot
…143)

* fix: Fix opendata module's create_users tests

* fix: Fix opendata module's create_users pycodestyle
* chore: remove unnecessary test-dependency (pymongo-stubs)
* chore: add typehint to fix mypy errors in anonymizer module

Refs: OPMONDEV-187
… and use the same version of Django declared as dependency in tests (#142)

* chore: Drop legacy support for Django 2.x in tests
* chore: Use Django version declared in requirements in tests too

Refs: OPMONDEV-187
* style: Use ruff for code linter and generate html reports for test results
* chore: Exclude F401 checks from Django related files
* chore: Remove unused imports
* chore: Remove unnecessary string formatting
* fix: Fix PR's review comments
* feat: Switch from pycodestyle to ruff as a linter
* fix: Fix errors after switching to ruff
* feat: Update run_tests.sh command to use ruff and run tests
* fix: Fix collector module failed type checks
* fix: Fix opendata module
…yf-version

fix: Freeze pydyf's version in dependencies to fix reports during runtime
chore: Update "make clean" command to clean test_results.xml and related htmlcov folder
chore: Add "make license" command to automate adding license headers to all source code, and update headers for all files

Refs: OPMONDEV-187
fix: Add missing make license command in anonymizer module
melbeltagy and others added 21 commits November 20, 2024 11:49
* fix: Migrate mongopy's collection#update to collection#update_one

Refs: OPMONDEV-187

* fix: Use correct syntax to update_one in corrector's database_manager

Refs: OPMONDEV-187
* docs: Add Developer's Guide documentation

Refs: OPMONDEV-187
…lds are missing and add them for the anonymizer module

implemented logic that patches DB table structure

refs: OPMONDEV-189
chore: Remove sensitive info from path variables from consumer messages
feat: as a Metrics User I want the database migration to check if fields are missing and add them for the anonymizer module
- Update path excludes.
- Remove Maven-specific scope excludes.
Bumps the python-major group with 1 update in the /opendata_module directory: [django](https://github.com/django/django).


Updates `django` from 3.2.20 to 4.2.18
- [Commits](django/django@3.2.20...4.2.18)

---
updated-dependencies:
- dependency-name: django
  dependency-type: direct:production
  update-type: version-update:semver-major
  dependency-group: python-major
...

Signed-off-by: dependabot[bot] <support@github.com>
…_module/python-major-caf2883180

chore(deps): bump django from 3.2.20 to 4.2.18 in /opendata_module in the python-major group across 1 directory
* feat: Prepare opendata_collector_module for release

fix type checking error
bump vcrpy test requirement
enable od-collector tests for github actions
bump lib versions
fix cron example
fail under 60pct of coverage
enable dependabot for opendata_collector_module

refs: OPMONDEV-191
…ow_vcrpy7

chore: ignore dependencies by dependabot; bump some dependency versions
Refs: OPMONDEV-190
chore: dependabot ignore pymongo >= 4.11 because of python >= 3.9
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants