Version 3.2.5

Fixed

Frontend

• different method of filtering fetch-intentions for particular credentials was introduced. It fixes cases where more than one set of credentials was used for the same organization and platform which resulted in records being mixed together
• a regression in dashboard SUSHI chart was fixed to include waiting harvests (broken in 3.2.4)

Backend

Added

Backend

Version 3.2.4

Fixed

Frontend

• test for /report/ as part of SUSHI URL was fixed to prevent false positives like https::/report.foo.bar/
• platform short_name is used if name is blank to prevent showing platforms with blank name
• tooltip for icons in SUSHI status was fixed

Changes

Backend

• the API to get status of "fetch attempts" was removed in favor of "fetch intentions" (is related to the above fix of tooltips)
• server log messages about user identity were changed from error to debug importance

Version 3.2.3

Fixed

Backend

• invitation links were fixed after switch to dj-rest-auth broke their functionality
• fix scheduling of FetchIntentions added by migration for older FetchAttempts - fixes overload of celery by endless stream of tasks without effect

Changes

Backend

• expiration was added to all celery tasks planned by celerybeat to avoid accumulation of tasks in queue if celery does not handle them quickly enough
• harvest API endpoint was optimized for speed

Version 3.2.2

Fixed

Frontend

Version 3.2.1

Added

Backend

Changes

Backend

Version 3.2.0

Added

Frontend

Backend

• it is now possible to export SUSHI credentials from the Django admin
• API key based authentication for specific API endpoints was implemented
• API endpoint for access to "raw" data for individual reports was added with API key access

Changes

Backend

• speed up loading of list of manual uploads by identifying import batches with their IDs only
• the API and related code for SUSHI harvesting was cleaned up by removing unused/obsolete code
• internal working of fetch attempt state was changed from several booleans into a progression of specific states
• replace django-rest-auth with dj-reset-auth
• manual data upload model was added into Django admin
• do not cache queries with empty result - removes delay between first data is harvested and displayed for new users
• list of platforms for an organization was made accessible using API key authentication
• deployment of requirements using requirements files for pip was dropped in favor of poetry

Fixed

Frontend

Backend

• the celery task for updating approximate number of records for a report type was not correctly scheduled
• do not respond by server error when user creates a platform with short_name that is already used
• parsing of exceptions from COUNTER 5 table format was made more robust
• code to derive SUSHI exception severity from a response was made more robust

Version 3.1.1

Changes

Frontend

• some less important columns are hidded from the SUSHI management page on smaller screens
• year selection for harvesting of SUSHI data was limited to years after 2010

Fixed

Frontend

Backend

• users with organization admin privileges are no longer denied access when manually importing data
• automatic deduction of title type using ISBN and ISSN was fixed to work in more cases, most notably for manually uploaded data
• performance of several API endpoints was fixed by optimizing the number of database queries
• data for SUSHI overview are correctly serialized even if harvested year is lower than 2000
• state of SUSHI fetch attempts marked as crashed because they were already imported was fixed (it no longer shows as crashed)

Version 3.1.0

Added

Frontend

• buttons for immediate harvesting and cancellation of harvests planned for later were added
• partial-data status was added to FetchAttempt information
• Celus frontend now checks the version of the backend and forces refresh if the versions do not match

Backend

• support for IR_M1 report was added
• ability to trigger postponed re-imports via celery was added to Django admin

Changes

Frontend

• harvest list view was extended and improved
• the 'Harvest selected' button on 'SUSH management page' was changed for better visibility
• all views were updated to stretch to the whole available space where the UI benefits from it
• empty harvests were hidden from harvest views
• obsolete Attempt overview view was removed from the UI
• the name of the organization created by the user after registration is limited to 100 characters
• user-created platforms and report types are marked with a special badge for easy recognition
• if a status filter is active on the sushi monthly overview page, it is automatically disabled when month is changed if there are no records with this status for the newly selected month

Backend

• Celery task locking was switched from Redis-based locks to database locks where appropriate
• extra whitespace is stripped from string values imported from C5 tabular format
• obsolete backend code related to the Attempt overview view was removed
• database unique constrains for short_name and source were reworked
• a Django setting was added to selectively allow manual upload of COUNTER data only
• speed and number of queries for listing harvest intentions was optimized

Fixed

Frontend

• when changing selected organization, the list of available platforms on the manual upload page is automatically refreshed
• date related filters were not copied when a report was copied
• 'untried' fetch-intention status was fixed to actually work
• sushi monthly overview no longer prematurely hides the loading progress bar which was confusing

Backend

Version 3.0.3

Fixed

Frontend

• fixed regression in SUSHI credentials edit dialog which caused selected report types to sometimes appear empty when viewing the first set of credentials
• Interest is not longer missing from the list of report types in the Reporting module
• position of 'Add annotation' and 'Add platform' buttons on the platform list page was adjusted for full visibility
• SUSHI harvesting progress dialog newly shows activity even between individual harvests
• integer overflow error was fixed in code determining how long to wait for new data when showing harvest progress
• use organization and platform short_name if full name is not available in the harvest list view

Backend

• memory consumption of importing data from a very large JSON files was optimized by processing files in chunks
• translation admin is properly used for all models using database translations
• uniform report type ordering is used in the SUSHI data view

Version 3.0.2

Fixed

Backend

• speed of resolving possible dimension values in report editor was dramatically improved in some cases - most notably when creating reports with titles in rows
• new materialized reports will not be immediately used until they are populated with data. This prevents intermittent loss of data in charts when new materialized reports are introduced

Version 3.0.1

Added

Backend

Changes

Backend

Fixed

Frontend

• ordering reports by primary dimension was fixed
• loading of date filter in report editor was fixed
• filtering by YOP is now possible in reporting due to the above mentioned change of dimension type
• adding filter for organization did not work properly when specific organization was selected globally

Version 3.0.0

Added

Frontend

• advanced reporting module - allows creation of custom reports by selecting desired output rows and columns with possible filtering.
• per credentials overview of harvested data was added. It shows harvests by years and allows quick reharvesting of missing data.
• it is now possible to create and edit platforms in the UI

Backend

• support for reading COUNTER 5 reports in table format was added
• management command for detection of conflicting import batches was added
• management command for removal of empty fetch attempts was added
• management command for removal of obsolete platform-title links

Changes

Frontend

• the left sidebar was reworked using collapsible entries to save space
• harvest overview was extended with more information
• it is now possible to only download data for one month using the "Save and test" button in the SUSHI credentials edit dialog
• when using the "Harvest selected" button for manual harvesting, the harvest is split into separate downloads for individual months
• crashed data imports are now marked as a distinct state with its own icon

Backend

• harvest scheduling was switched to the new system by default. This means that future harvests are planned automatically in advance and past data have to be explicitly harvested by the user.
• HTTP authentication information was removed from COUNTER 5 SUSHI credentials as it is not used there
• better handling of SUSHI exceptions 1030, 2010 and 3060 was added. Errors 1030 and 2010 causes credentials to be marked as broken
• scheduler admin was improved

Fixed

Frontend

• fix reporting of used metrics for interest related charts when materialized reports are used in the background
• harvest view was optimized for speed
• error when clearing search text on SUSHI management page using the "x" icon was fixed
• error which caused reports types sometimes not appearing when editing SUSHI credentials was fixed

Backend

• update Cachalot to a newer version containing our fix for temporary disabling of Cachalot
• fixes memory problems when exporting large amounts of raw data
• fix for error causing users to be disconnected from their organizations upon login of other user when live ERMS sync was used was ported from 1.0.x
• database constraints enforcing uniqueness in combination with source were fixed to properly handle source being null.
• scheduling of harvests for new months was fixed to wait until month end before attempting to harvest data for that month
• reevaluation of queries by recache was fixed - it did not occur because of wrong celery config