simplify/enable minibatch streams, pip+git sourced scripts, tensorflow 2.3, versioned model promotion, sql-dbms namespaces, bug fixes
Examples:
$ om shell
stream producer, benchmarked to 60K messages/s
[] stream = om.streams.get('astream')
stream.append({'foo': 'bar'])
stream consumer with window size = 2, windows are processed in parallel
[] streaming = om.streams.getl('astream', size=2)
streaming(lambda window: print(window)) => print every 2 messages
pip+git sources scripts
[] om.scripts.put('pypi://package', 'mymodule')
om.scripts.put('git+https://url/repo/package', 'mymodule')
om.runtime.script('mymodule').run()
sql namespacing using buckets, like with MongoDB
[] -- the default table when storing data is {bucket}_{name}, override using table='myname'
om.datasets.put(sqlalchemy_constr, 'mysqlalchemy', table='mytable', sql='select ...', copy=True)
-- to use a specific table, without bucket information use table=':myname'
om.datasets.put(sqlalchemy_constr, 'mysqlalchemy', table=':mytable', sql='select ...', copy=True)
om.datasets.get('mysqlalchemy') read from myname
Changes:
684f83d fixing several bugs (123)
841e19c enable combined stores (120)
b7b732e add streams as a first-class object type (121)
da5675f various improvements (119)
0a2db44 Simplify releases (122)
b322a11 fix mdataframe.merge duplicate keys error on 1:n merges (117)
9da78b5 enable bucket namespacing for sql datasources (116)
7a03043 support omegamlee-1.4.1 (115)
5c6d56d enable remote source packages (113)
22ffcb2 updates for stability and increased performance (111)
c3e9e5e enable tensorflow 2.3.0 (unit testing) (110)
b20e8c6 enable promotion of versioned models to work as expected (109)
89bdb96 various updates, stability improvements (105)