CHANGELOG.md

Changelog

All notable changes to this project will be documented in this file.

The format is based on Keep a Changelog, and this project adheres to Semantic Versioning.

Added - for new features. Changed - for changes in existing functionality. Deprecated - for soon-to-be removed features. Removed - for now removed features. Fixed - for any bug fixes. Security - in case of vulnerabilities.

Unreleased - XXXX-XX-XX

[1.4.7] - 2021-11-18

Fixed

• Publish dataset with recourses of type zip
• Docker tool to work with testdata.egov.bg

[1.4.6] - 2021-11-05

Added

• Docker tool to work with testdata.egov.bg

[1.4.5] - 2021-11-05

Added

• Matomo tracking code

Changed

• api listDatasets default filters to match site Data section
• Info logs to use different file info.log instead of laravel.log

[1.4.4] - 2021-10-05

Changed

• Dataset create form visibility defaults to public

[1.4.3] - 2021-10-05

Added

• Dataset list access filter - free and paid

Removed

• Dataset list filters by user and groups

[1.4.2] - 2021-08-20

Added

• Upload resource in zip format to data sets

Fixed

• Zip download formats in dataset view

[1.4.1] - 2021-08-18

Added

• Send a notification emails to admins when a resource report signal is send
• Send a notification emails to admins when a data request is send

Fixed

• Emails list in warning email when Elasticsearch cluster's node is down

[1.4.0] - 2021-07-23

Added

• Artisan command to check if all the Elasticsearch cluster's nodes are in good health and if a node is down send warning emails to admins
• Artisan command for reindexing resources in Elasticsearch
• Move all resources from one data set to another and reindex the resources in Elasticsearch

Changed

• Elasticsearch mapping from dynamic true to false when creating new resource and when reindexing (prevent issue of mapping explosion)

Fixed

• News type in add and edit news. On delete check if news type is for latest news and if so clear the cache for the latest news on the home page
• Last updated date on the dateset page, it doesn't get updated when updating resource via API

[1.3.0] - 2021-06-28

Added

• News type to news that can be regular, latest news for home page and alert
• Latest news box to the home page
• Alert news displayed just below the horizontal menu in the colored lane
• Resources direct download links for the different formats to the resource's details page
• Error pages 404, 500, 505
• Download links for zip files in a different format with all the resources in a data set

Changed

• Replace registered user's count in the green box on the home page with organizations count
• Disable the first three fields in organization's edit form for all users except admins
• Temporarily remove the restriction of maximum 800 characters for news body
• Make an excerpt from the first 3000 characters of the resource preview when it is in json or xml format on the resource's details page

Fixed

• Typo in data sets text on home page

Removed

• Home page boxes for organizations count and updates count

[1.2.5] - 2020-09-18

Changed

• Report Elasticsearch red indices command

[1.2.4] - 2020-09-17

Changed

• Report Elasticsearch red indices command

[1.2.3] - 2020-09-16

Fixed

• Tool installation files

[1.2.2] - 2020-09-14

Added

• Contact phone to users
• reCaptcha to data requests and log in forms
• Data set setting for publishing data without admin approval

Fixed

• Social media buttons on mobile screen
• Resource pagination info

Changed

• Маке data set uri readonly field with auto generated value
• Disable user registration functionality

[1.2.1] - 2020-08-31

Added

• Report Elasticsearch red indices command

[1.2] - 2020-08-20

Fixed

• User rights issue

Added

• COVID-19 resource visualizations
• Dynamic addition of sections in the footer area
• Name and information about the Portal in the header area
• Send information to Graylog for resource data requests through the API
• Merged pull request #28
• reCAPTCHA v2 checkbox

Changed

• Social media buttons functionality
• Make "Organisation" mandatory field when publishing data

1.1.22 - 2020-03-12

Fixed

• Removal of user rights

1.1.21 - 2020-03-04

Fixed

• Incorrect validation to edit user

1.1.20 - 2020-02-28

Fixed

• A few typos
• Multi-user registrations

Changed

• Ordering of public documents

1.1.19 - 2019-12-19

Changed

• Updated_by property controlled through trait

1.1.18 - 2019-12-19

Fixed

• Filename error during download of resource

1.1.17 - 2019-11-19

Removed

• Temporarily remove signal button

1.1.16 - 2019-11-14

Removed

• Temporarily disable signal creation

1.1.15 - 2019-10-01

Added

• Commands for elasticsearch data backup

Fixed

• Relation retrieval for action history
• User e-mail invite button

1.1.14 - 2019-09-12

Added

• Conversion for html files

Fixed

• Editing datasets through API without org_id
• Newsletter object error

1.1.13 - 2019-09-10

Added

• Option to manipulate xml size limits and field depth

Changed

• Timeout for dataset publish

1.1.12 - 2019-09-03

Added

• Option to manipulate resource mapping

1.1.11 - 2019-08-20

Added

• Setup of multiple elastic hosts
• Additional validation for dataset publish

Fixed

• Subcategory deletion redirect
• Public filter interactions and ordering
• Load times of history of actions, logins by setting default dates
• Query for most active organisation
• Limit of organisation list for data requests

1.1.10 - 2019-07-23

Added

• Command for removal of elastic indices without metadata
• Command for removal of elastic indices deleted during migration

Fixed

• Load speed of notifications page

1.1.9 - 2019-07-17

Fixed

• Version visualisations
• Tool honors new api required params
• Minor visual fixes in tool interface

1.1.8 - 2019-07-15

Fixed

• Issue with tool installation
• Visual fixes for resource visualisation
• Further improved loading of notifications page
• Signals query
• Minor visual fixes

1.1.7 - 2019-06-27

Added

• Admin functionality for final resource removal

Fixed

• Visual fixes
• Fix display of xls, xlsx as csv for readability
• Improved loading of notifications page
• Visualisation of xsd format
• Redirect after dataset delete
• Migration of windows-1251 encoded files

1.1.6 - 2019-06-13

Added

• Footer text

Fixed

• Hide download button if resource has no data
• Various optimizations of queries
• Foreign key for tags
• Signals page issue

1.1.5 - 2019-05-20

Added

• Dataset view resources download button

Fixed

• Attributes after xml conversion
• Use html_entities_decode after json2xml conversion

Changed

• Throw error when publishing a dataset which has resources with no data
• Remove additional root element on json2xml conversion

1.1.4 - 2019-04-01

Fixed

• Dockerfile graylog port and database host

Changed

• Improved exceptions logs

1.1.3 - 2019-03-29

Fixed

• Xml resource visualisations
• Xsd resource visualisations
• Wrong tool constant
• Tool ssl connection to api
• Detect same text in previous version when updating resource data

1.1.2 - 2019-03-22

Fixed

• Confirmation email heading on user email change

1.1.1 - 2019-03-22

Changed

• Format WORD to DOC in data migration command
• Library to gnumeic for ods/xls/xlsx conversions
• Forgotten password email text
• Changed user email text

Fixed

• Use gnumeic for xml conversion if exported for excel

1.1.0 - 2019-03-19

Added

• Remove uncessary and incorrect copyright statement from the footer (Pull request)

1.0.26 - 2019-03-19

Fixed

• Order by column on resource type CSV visualization
• User IP address in actions history
• Sort error on actions history view
• Improved sorting and filtering in actions history view

Changed

• Change Elasticsearch data structure

1.0.25 - 2019-03-07

Fixed

• Keep approved value on edit organisation
• Hide public area datasets if organisation is not active or not approved
• Search and paging on resource type CSV visualization
• Compare lowercase types before conversion

Changed

• Api listDatasets additional array parameter criteria[public] (optional)

Added

• Update elastic text keys command

1.0.24 - 2019-03-05

Fixed

• Improved resource type csv visualization
• Improved csv delimiters
• Improved pdf conversion and file format
• Updation info for datasets and resources
• Search in organisation members pagination

1.0.23 - 2019-02-28

Fixed

• List datasets api function pagination

Removed

• Remove data sets from inactive and not approved organisations

1.0.22 - 2019-02-28

Changed

• Homepage statistics with cron and cache

Fixed

• Download resources with long names

1.0.21 - 2019-02-28

Fixed

• Get resource format from file extension
• Update resource/dataset version only if resource`s data will be uploaded to elastic

1.0.20 - 2019-02-27

Added

• Different csv delimiters
• Username to member invitation mail

Changed

• New pdf library (smalot/pdfparser)

Fixed

• Search results ordering in my data section
• Remove data sets from inactive and not approved organisations

1.0.19 - 2019-02-25

Fixed

• Multi page pdf conversion
• Optimise chronology loading
• Missing label
• Fix showing user`s datasets
• More specific searching by keyword
• Pagination URLs in admin panel, my data section
• Missing versions list in resource views
• Convert Windows-1251 encoding to UTF-8

1.0.18 - 2019-02-20

Fixed

• Url for downloading resources
• Refactoring of migration for repairing migrated data

1.0.17 - 2019-02-20

Added

• Elastic mapper settings command (php artisan elastic:mapper)
• CSV resource upload test and test file

Changed

• Refactoring of initial migration
• Change old portal source for retrieving data from API

1.0.16 - 2019-02-15

Fixed

• Trusted proxies config

1.0.15 - 2019-02-15

Fixed

• On migrating specific data with delete - remove only previous migrated datasets
• Store elastic data in session by key (uri of the resource)

Added

• Trusted proxies config

Changed

• Improved dataset and resources transactions

1.0.14 - 2019-02-13

Fixed

• Organisations and groups search order
• Memory usage accumulation during conversion (xls, ods, slk, csv)
• Associate migrated users with their profiles in old system
• Large csv resources loading

Added

• Pagination for data set resources

1.0.13 - 2019-01-31

Added

• Add field is_migrated to dataset and resources
• Migration for specific data (by organisation, by dataset, single resource)
• Migrated data statistics command (php artisan data:statistics)
• File input for resources with type Automatic upload

1.0.12 - 2018-12-11

Added

• Scroll in dropdown filters
• Command for re-download broken resources

Fixed

• Newsletter on post
• Resource type API automatic update
• Resource file type pdf upload
• Resource type API update interval check
• Personal data check on resource edit
• Data set links in Data page

1.0.11 - 2018-12-03

Fixed

• Fix migration undefined index

1.0.10 - 2018-12-03

Fixed

• Resource versions order
• Resource preview for non-authenticated users

1.0.9 - 2018-12-03

Fixed

• Remove comment button from documents view
• Resource preview
• Tool time filter in history page
• Escape XML resource special characters
• Tool DBSM edit and file check
• Undefined variable in migration

1.0.8 - 2018-11-26

Added

• Tool file data preview
• Tool multiple databases support
• Tool history pagination on top

Changed

• Tool devide database and file connections
• Refactor tool code

Fixed

• Fix resource query script parameters format
• Resource preview for all formats
• Tool database preview
• Tool history pagination clears filters
• Tool query filter
• Tool driver filter
• Tool type filter

1.0.7 - 2018-11-22

Added

• Automatic upload resource type
• Api updateResourceData format parameter

Fixed

• Automatic newsletters and tool resources send timing
• Tool file folder syncronisation on automatic restart

1.0.6 - 2018-11-20

Changed

• Elastic search index clean command

1.0.5 - 2018-11-20

Added

• Elastic search index clean command

Fixed

• Resource download needs authentication
• Main categories file preview in admin panel
• Login history bug
• Dataset filtering bug

Changed

• Base categories names in insert migration

1.0.4 - 2018-11-15

Fixed

• Personal information check to work for 10 digit chunks only
• Send newsletters on post
• Edit API information for resources type API
• Tool history
• Tool mail notifications and errors
• Tool cron resource updates

Added

• Мodules code in API listModules() response
• Module "Modules" in rights list

1.0.3 - 2018-11-14

Fixed

• uri in listDataGroups() and listDataOrganisations() responses
• Tool install script container destroy order for windows
• Tool graylog host
• Tool file exists check

1.0.2 - 2018-11-14

Added

• Resource queries tool in admin edit pages section

Changed

• Remove 'help_section' parameter from API SectionController::addSection() and editSection()
• Remove 'help_page' parameter from API SectionController::addPage() and editPage()
• Drop 'help_section' column from 'sections' table
• Drop 'help_page' column from 'pages' table

Fixed

• Hide not active sections, subsections and pages from Help guide
• Add missing right checks API functions
• Admin documents edit
• Tool dockerfile api url
• Tool database connection for localhosts
• Tool persistent database volume
• Tool cron resource updates
• Tool history statuses
• Tool file not found error

1.0.1 - 2018-11-05

Added

• Statistics and analytics link in admin navigation bar
• Tool daily database external backups

Changed

• Images and documents to database instead of files
• Add resources info in RSS feed

Fixed

• Forum discussions for public data section
• Admin inactive sections preview
• Admin inactive help sections creation
• Api missing routes error
• Api groups and organisations unique id error message
• Api groups and organisations image upload
• Main category adding
• Main category without image showing
• User rights on resources in user panel
• Microsoft Edge help icon fix
• API conversions from json format

1.0.0 - 2018-10-31

Added

• Resource update equal data in previous version check
• Tool mail notifications
• Resource queries tool in admin add pages section
• Send query button functionality for the tool
• Edit saved query functionality for the tool
• Send newsletters
• Tool installation and docker files
• Automated api resource upload
• Api getResourceView function

Changed

• Search engine sqlite indexes to mysql
• Add admin check for editing and adding organisations
• Tool file uploads with docker volume

Remove

• Cron job for sqlite index updates

Fixed

• Help page stays open after being selected
• Images uploaded from admin panel show for all users
• If help page is inactive you can go to edit from the help sidebar
• Timezone to Europe/Sofia
• Resource from docx
• Resource visualisation ordering

0.6.5 - 2018-10-24

Added

• Users can add datasets to groups from a public dataset view
• More specific error message for resources upload

Changed

• Allow only svg in admin category upload

Fixed

• Modals not opening
• Category list icon data encoding
• Dataset buttons in public section
• Resource redirect after delete
• Search indexes permissions
• Update datasets version
• Subsection not deleting
• Connection to APIs for resource data
• On user login set locale from user settings
• listUsers() response in xml and without api key
• Cyrillic letters in downloaded json
• Dataset filters in public section

0.6.4 - 2018-10-19

Added

• Forum discussions to public data and documents sections
• Cron task to initiate search indexes update every 5 minutes

Changed

• Help stays open until closed
• Help no longer transparent
• Help close icon changed
• Optimised tnt search indexes refresh command
• Remove searchable models automatic index sync on create and update

Fixed

• Editing active and inactive help sections and pages
• Scroll shows in help container
• Redirect after dataset creation
• Hovering main categories
• Show help section icon in footer on mobile view
• Filter resource download formats

0.6.3 - 2018-10-18

Added

• TNT search indexes refresh command
• Visualizations pages

Changed

• Translations table text column length
• Group datasets delete button changed to remove
• Group datasets edit button removed

Fixed

• WYSIWYG editor code view, full screen mode
• Missing conversion methods
• Unclosed span tag
• Search pagination
• HTML error when creating dataset form API
• Bug in showing inactive news to logged users
• Visual glitches in IE and mobile version
• Bugs in showing system information about records
• Dubious column names in documents and organisations
• Resource download

0.6.2 - 2018-10-17

Fixed

• Organisations search
• Delete own account
• Account creator

0.6.1 - 2018-10-16

Added

• Api removeDatasetFromGroup parameter group_id now is a array of ids
• Add api connnection for files, soft deletes and update history (Tool)
• Version link (Tool)
• History pagination (Tool)
• Visual impovements

Fixed

• Help sections optimisation
• Datasets and resources version bug
• Resources and datasets refactoring and optimisation
• Edit dataset can not deselect groups and organisation
• Dataset edit groups and organisation inputs
• Show inactive subsections and sections in admin area
• Invite bug
• Sticky footer

0.6.0 - 2018-10-08

Added

• Change log
• Tool history page
• RSS feed for news
• RSS feed for datasets
• Insert base terms of use
• Google analytics integration
• Filter for personal information
• Help functionality for all pages
• Required sections and static pages
• RSS feed for organisation datasets
• Map old license ids with the new terms of use

Fixed

• Refactored and optimised tests
• Activation link for deactivated users
• Admin subsections listing

0.5.1 - 2018-10-03

Fixed

• Api sorting improvement
• Document upload and download fixes
• Various code refactoring
• Filter improvements
• Data migration fixes

Removed

• Duplicate search functionality from api methods

0.5.0 - 2018-10-01

Added

• Inital tool and tool design
• Help pages and help pages controls to admin panel
• Social networks sharing
• Public datasets, organisations and groups
• User experience upgrades through additional controls
• Various visual improvements

Fixed

• Addition of missing base roles to migration
• Data migration fixes
• Search engine fixes