Changelogs » Aioradio

PyUp Safety actively tracks 323,951 Python packages for vulnerabilities and notifies you when to upgrade.

Aioradio

0.14.3

* Add SentTimestamp attribute to SQS get_messages function.

0.14.2

* Update aioboto3==9.2.0.

0.14.1

* Relaxed aioboto3, aiobotocore & boto3 version requirements to work with python3.7 since new versions of aioboto3 are limited to python3.8+.

0.14.0

* Update aioboto3==9.1.0, aiobotocore==1.3.3, boto3==1.17.106 & moto==2.1.0.

0.13.18

* Use json instead of data for callback.

0.13.17

* Update long running jobs callback to use data instead of params in post.

0.13.16

* Update boto3==1.16.52.

0.13.15

* Update aiobotocore==1.2.2.

0.13.14

* Assign fixed version for python packages.

0.13.13

* Add callback_url functionality in long_running_jobs.

0.13.12

* Remove logging in aioradio/aws/utils.py.
  * Skip all tests interacting with FTP.

0.13.11

* Add SQL Server 2017 driver path for Debian operating systems.
  * Moving pyodbc.connect port reference within the SERVER term (ex. "<server>,5123")

0.13.8

* Add application_intent & tds_version as pyodbc connection options.

0.13.7

-----------------------
  
  * Add attr_before parameter in pyodbc.connect.

0.13.5

-----------------------
  
  * Add functions (create_multipart_upload, upload_part, complete_multipart_upload, abort_multipart_upload, list_parts) to s3 multipart upload.

0.13.4

-----------------------
  
  * Remove sensitive company email addresses along with database, redis and secret manager info.

0.13.3

-----------------------
  
  * Fix issue with pulling more than one message in LongRunningJobs.

0.13.2

-----------------------
  
  * Add ability for LongRunningJobs to run one to many jobs.

0.13.1

-----------------------
  
  * Updating LongRunningJob to use either 'sqs' or 'redis' as the queue mechanism.

0.13.0

-----------------------
  
  * Adding Long Running Job worker class to work asynchronously with client.

0.12.5

-----------------------
  
  * Add Trusted_Connection to pyodbc options.

0.12.4

-----------------------
  
  * Add ability to set encoding on Redis client.

0.12.3

-----------------------
  
  * Use redis instead of aioredis because it is maintained much better by developers.
  * Removed aioredis examples from README.md since using aioradio for redis has no benefit over simply using redis.

0.12.0

-----------------------
  
  * Use aioredis transactions performance fixed branch (sean/aioredis-redis-py-compliance) instead of version 1.3.1.

0.11.7

-----------------------
  
  * Fix syntax error in manage_async_tasks where append should be equal symbol.

0.11.6

-----------------------
  
  * Simplify manage_async_tasks args to include list of coroutines.

0.11.5

-----------------------
  
  * Add manage_async_tasks & manage_async_to_thread_tasks async functions in aioradio/utils.py.

0.11.4

-----------------------
  
  * Use redis transactions via pipelining with hash set & expire commands.

0.11.3

-----------------------
  
  * Fix pydoc errors in redis.py file.

0.11.2

-----------------------
  
  * Add custom hmget_many & hmgetall_many redis commands to get many hashed keys data.

0.11.1

-----------------------
  
  * Fix issue with sending None values in redis func hmget.

0.11.0

-----------------------
  
  * Add initial support in redis for the hashes data structure.

0.10.4

-----------------------
  
  * Add pyodbc driver string for windows OS.

0.10.3

-----------------------
  
  * Modify async_wrapper to not directly use await within wrapper.

0.10.2

-----------------------
  
  * Use await in async_db_wrapper instead of using asyncio.get_event_loop.run_until_complete.

0.10.1

-----------------------
  
  * Add missing comma in install_requires.

0.10.0

-----------------------
  
  * Add decorator to manage DB connections and using SQL transactions.

0.9.8

-----------------------
  
  * Add ability to add more regions besides us-east-1 & us-east-2.

0.9.7

-----------------------
  
  * Give async_wrapper decorator wrapper parent function name.

0.9.6

-----------------------
  
  * Apply pydoc to repository.
  * Add isort and docformatter to pre-commit.

0.9.5

-----------------------
  
  * Fix bug with reseting list during paginate of list_objects.

0.9.4

-----------------------
  
  * Adding the with_attributes parameter to list_s3_objects function.

0.9.3

-----------------------
  
  * Add functions (get_ftp_file_attributes & get_s3_file_attributes) to retrieve metadata on files in FTP and S3.

0.9.2

-----------------------
  
  * Update aioboto3==8.2.0

0.9.1

-----------------------
  
  * Add ddtrace logger to DatadogLogger by default saving the user having to pass this info on their side.

0.9.0

-----------------------
  
  * Set logger.propogate to False after adding handler.
  * Remove use_ddtrace logic from DatadogLogger.

0.8.5

-----------------------
  
  * Fix bug with accessing active keyword incorrectly in aws/utils.py aio_server function.

0.8.4

-----------------------
  
  * Add documentation and usage examples for onboarding new users from pypi and github pages.

0.8.3

-----------------------
  
  * Set busy flag to true on creation.

0.8.2

-----------------------
  
  * Fix issue with incorrect busy signal.

0.8.0

-----------------------
  
  * Replace python-utils repository with new name: aioradio.

0.7.4

-----------------------
  
  * Add redis class object pool_task to run async task in fastapi startup function to create redis class pool object.

0.7.3

-----------------------
  
  * Add async event loop logic when instantiating redis pool.

0.7.2

-----------------------
  
  * Add boto3 to install_requires within setup.py.

0.7.1

-----------------------
  
  * Fix missing None values in result from redis get_many_items function.
  * Update aiobotocore==1.1.2.

0.7.0

-----------------------
  
  * Remove fice institution mapping logic as it is too NRCCUA specific for an open source project.
  * Refactored tests to no longer use AWS secrets manager for creds but use environment variables instead.

0.6.10

-----------------------
  
  * Remove None values from redis build_cache_key function.
  * Use fakeredis instead of real elasticache resource.

0.6.7

-----------------------
  
  * Removed closing AioSession as it is unnecessary.

0.6.6

-----------------------
  
  * Add ability to refresh aioboto3 client/resource every sleep interval.

0.6.5

-----------------------
  
  * No longer closing the AioSession in utils.py.

0.6.3

-----------------------
  
  * Converted using real AWS resources to implementing mock moto server with aiobotocore and aioboto3.

0.6.2

-----------------------
  
  * Redis SET using orjson no longer decoding the cache value, but instead write the value as bytes.

0.6.1

-----------------------
  
  * Replace ujson with orjson for faster serialization/deserialization.

0.6.0

-----------------------
  
  * Add redis to python-utils.

0.5.7

-----------------------
  
  * Fix bug with not passing in region to sqs client.

0.5.6

-----------------------
  
  * Improved the implimentation of the aiojobs scheduler and active decorator by using a class in utils.py.

0.5.5

-----------------------
  
  * Replace print statements with logger in sqs.py and s3.py.

0.5.4

-----------------------
  
  * Improved AioSession refresh logic by setting client to None after exiting context manager.
  * Adding logging in sqs.py and s3.py.

0.5.3

-----------------------
  
  * Use asyncio.create_task instead of loop.run_until_complete.

0.5.2

-----------------------
  
  * Fix bug with issuing raise out of scope.

0.5.1

-----------------------
  
  * Fix bug with the active decorator counter not decrementing.
  * Removed setting level of root logger.

0.5.0

-----------------------
  
  * Add logging during reacquiring the s3 or sqs sessions.
  * Refactor the Logger to DatadogLogger making it specific to use with Datadog.

0.4.10

-----------------------
  
  * Improve get event logic in s3.py and sqs.py by always attempting to instantiate the using get_event_loop before using new_event_loop.

0.4.9

-----------------------
  
  * Add missing await to asyncio.sleep

0.4.8

-----------------------
  
  * Use asyncio.new_event_loop() in s3.py and sqs.py else use asyncio.get_event_loop() when running pytest.

0.4.7

-----------------------
  
  * Removed uvloop from python-utils since it was causing issues with streamlit.

0.4.6

-----------------------
  
  * Changed timeout value from 0.1 to 300 seconds in function establish_s3_client.

0.4.5

-----------------------
  
  * Add waiting mechanism in active decorator until the client key is set.

0.4.4

-----------------------
  
  * Add uvloop and aiojobs to install_requires in setup.py.

0.4.3

-----------------------
  
  * Adding uvloop==0.14.0 to speed up the event loop.

0.4.2

-----------------------
  
  * Replace aioboto3 with aiobotocore when appropriate.
  * Adding a longer lasting AioSession client (5 minutes) for sqs and s3 for better performance.

0.4.1

-----------------------
  
  * Update ddtrace from 0.40.0 to 0.41.2 to allow support for asgi integration.
  * Adding a file_ingestion function delete_ftp_file.

0.4.0

-----------------------
  
  * Separate pyodbc logic into its own module.

0.3.10

-----------------------
  
  * Obtain complete objects streamed bytes from s3 get_object function.

0.3.9

-----------------------
  
  * Add s3 function get_object to download contents of an s3 file directly.

0.3.8

-----------------------
  
  * Add missing library httpx to python-utils package.

0.3.7

-----------------------
  
  * Add generic jira functions post_jira_issue, get_jira_issue and add_comment_to_jira.
  * Add s3 function upload_fileobj to basically upload a file using the file descriptor.
  * Add dynamo function batch_get_items_from_dynamo to batch GET items.
  * Add file ingestion function list_ftp_objects to list files & directory at an FTP path.

0.3.6

-----------------------
  
  * Add async process manager using either threads or asyncio.gather that can manage a fix number of async processes.

0.3.5

-----------------------
  
  * Add options use_ntlm_v2 & is_direct_tcp to establish_ftp_connection.

0.3.4

-----------------------
  
  * Switch to using DNS instead of IP for FTP connection.
  * Add async_wrapper function in file_ingestion that can be used as a decorator for DAG tasks to enable await usage.

0.3.3

-----------------------
  
  * Using new secret names in tests.

0.3.2

-----------------------
  
  * Use consistent AWS Secret Manager secret names across accounts and environments.

0.3.1

-----------------------
  
  * Whenever importing package files prepend with python_utils.

0.3.0

-----------------------
  
  * Add getting secrets from AWS Secrets Manager in python_utils/aws/secrets.py
  * Removed pyodbc from install_required

0.2.8

-----------------------
  
  * Hard-code version for each python package in requirements.txt.
  * Fix missing comma between aioboto3 and ddtrace in setup.py.
  * Adding a check of installing setup.py with the cmd: make all.

0.2.7

-----------------------
  
  * Adding to install_requires in setup.py: aioboto3.

0.2.6

-----------------------
  
  * Add the data folder and its contents to the package, currently to use fice_institution_mapping.xlsx.

0.2.5

-----------------------
  
  * Fix spelling from pyobdc to pyodbc in setup.py

0.2.4

-----------------------
  
  * Adding to install_requires in setup.py: mandrill, pyobdc, pysmb, & xlrd.

0.2.3

-----------------------
  
  * Adding python package pytest-cov==2.10.0 with minimum coverage of 95% allowed.
  * Extracting generic functions from EFI that appear to be appropriate for use across python projects.

0.2.2

-----------------------
  
  * Added "python_utils/aws" directory to the packages in setup.py

0.2.1

-----------------------
  
  * Generate v0.2.1 for initial release of python-utils

0.2.0

-----------------------
  
  * Add async AWS library with initial support for common SQS, S3 & DynamoDB functions.

0.1.8

-----------------------
  
  * Fix comparing console_logger with all_loggers list.

0.1.7

-----------------------
  
  * Adjusting console logger to only add handler if the logger doesn't initially exist.

0.1.6

-----------------------
  
  * Fill in readme
  * Add pre-commit github action

0.1.5

* Adding tests to repository and pre-commit
  * Allow for dynamic formatting of message.
  * Add ddtrace==0.39.0 integrating with running via docker
  * Add ability to install via setup.py.
  * Add generic logger for either local or docker environment, which includes improved Datadog logging.