Streamsx-hdfs

Latest version: v0.1.0

Safety actively analyzes 623075 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 1 of 2

4.3.0

The operator **HDFS2FileSink** provides a new parameter **tempFile**.
The **tempFile** parameter specifies the name of the file that the operator writes to. When the file is closed the file is renamed to the final filename defined by the **file** parameter.

4.2.0

The **streamx.hdfs.toolkits-4.2.0** release delivers corrections for FileNotFoundException issue 100 and issue 90
The release has been created on a RedHad 7.5 linux server with
IBM Streams Version=**4.3.0.0** Build=20180725113900
This release fixed also divers deprecated hadoop functions.

4.1.0

The HDFS Toolkit has been improved to support the IBM Streams on Cloud.
A new pom.xml file download only the needed JAR libraries to build the toolkit.
The Hadoop JAR libraries are now integrated in the toolkit lib/ext directory.

The HDFS Toolkit has now a reconnection policy. It tries to reconnect to the HDFS when it fails
All operators have now 4 new parameters:
hdfsPassword
reconnectionPolicy
reconnectionBound
reconnectionInterval

It is now possible to submit an SPL application on IBM Streams Cloud without any
Hadoop client installation on Streams server.

A sample has been provided to describe the build and submit a SPL application with new
version of HDFS Toolkit.
https://github.com/IBMStreams/streamsx.hdfs/wiki/How-to-connect-to-TAE-vai-HDFS-Toolkit

3.1.0

The HDFS toolkit has been built wit Streams:
Version=4.2.1.1
ProductName=IBM Streams
Build=20170404211051
Architecture=x86_64
OS=Red Hat Enterprise Linux Server release 6.6 (Santiago)

3.0.100

This is version 3.0.100 of the HDFS toolkit as released in Streams 4.2.

It includes:
- Support for BigInsights 4.2.
- Minor enhancements and fixes (issues 55 and 79)


3.5.1-bluemix
This release adds support for the paid BigInsights for Apache Hadoop service on Bluemix.


3.5.0-bluemix
This is an official release of the HDFS v3.5.0 toolkit to support the **Analytics for Apache Hadoop** service and the **Streaming Analytics** (Streams 4.1) service on Bluemix.

Highlights of the release include:
- Support for information governance


2.1.0-bluemix
This is the first release of the HDFS for Bluemix toolkit and has been tested with the **Analytics for Apache Hadoop** service and the **Streaming Analytics** (Streams 4.1) service on Bluemix. It does not include support for information governance.

3.0.0

This is an official release of the HDFS v3.0.0 toolkit to support IBM Streams v4.1.
Highlights of the release include:
- Support for data governance
- Support for IBM BigInsights 4.1


bluemix-0.3.2-alpha
This provides support for HDFS access on Bluemix. It includes:
- `WebHdfsRead` and `WebHdfsReadFiles` for reading files
- `WebHdfsWrite` for writing files
- `WebHdfsDirectoryScan` for scanning directories.

This release brings:
- samples importable in StreamsStudio and other sample cleanup
- composite operators use partitionColocation to fuse their operators together

Page 1 of 2

© 2024 Safety CLI Cybersecurity Inc. All Rights Reserved.