Run Python in Apache Storm topologies. Pythonic API, CLI tooling, and a topology DSL.
See the code|logo| |Build Status| |Docs Status| Streamparse lets you run Python code against real-time streams of data via Apache Storm. With streamparse you can create Storm bolts and spouts in Python without having to write a single line of Java. It also provides handy CLI utilities for managing Storm clusters and projects. The Storm/streamparse combo can be viewed as a more robust alternative to Python worker-and-queue systems, as might be built atop frameworks like Celery and RQ. It offers a way to do "real-time map/reduce style computation" against live streams of data. It can also be a powerful way to scale long-running, highly parallel Python processes in production. |Demo| Documentation ------------- * `HEAD <http://streamparse.readthedocs.org/en/master/>`_ * `Stable <http://streamparse.readthedocs.org/en/stable/>`_ User Group ---------- Follow the project's progress, get involved, submit ideas and ask for help via our Google Group, `streamparse@googlegroups.com <https://groups.google.com/forum/#!forum/streamparse>`__. Contributors ------------ Alphabetical, by last name: - Dan Blanchard (`@dsblanch <https://twitter.com/dsblanch>`__) - Keith Bourgoin (`@kbourgoin <https://twitter.com/kbourgoin>`__) - Arturo Filastò (`@hellais <https://github.com/hellais>`__) - Jeffrey Godwyll (`@rey12rey <https://twitter.com/rey12rey>`__) - Daniel Hodges (`@hodgesds <https://github.com/hodgesds>`__) - Wieland Hoffmann (`@mineo <https://github.com/mineo>`__) - Tim Hopper (`@tdhopper <https://twitter.com/tdhopper>`__) - Omer Katz (`@thedrow <https://github.com/thedrow>`__) - Aiyesha Ma (`@Aiyesha <https://github.com/Aiyesha>`__) - Andrew Montalenti (`@amontalenti <https://twitter.com/amontalenti>`__) - Rohit Sankaran (`@roadhead <https://twitter.com/roadhead>`__) - Viktor Shlapakov (`@vshlapakov <https://github.com/vshlapakov>`__) - Mike Sukmanowsky (`@msukmanowsky <https://twitter.com/msukmanowsky>`__) - Cody Wilbourn (`@codywilbourn <https://github.com/codywilbourn>`__) - Curtis Vogt (`@omus <https://github.com/omus>`__) Changelog --------- See the `releases <https://github.com/Parsely/streamparse/releases>`__ page on GitHub. Roadmap ------- See the `Roadmap <https://github.com/Parsely/streamparse/wiki/Roadmap>`__. .. |logo| image:: https://raw.githubusercontent.com/Parsely/streamparse/master/doc/images/streamparse-logo.png .. |Build Status| image:: https://github.com/pystorm/streamparse/actions/workflows/test.yml/badge.svg :target: https://github.com/pystorm/streamparse/actions/workflows/test.yml :alt: Build Status .. |Docs Status| image:: https://readthedocs.org/projects/streamparse/badge/?version=latest :target: https://streamparse.readthedocs.io/en/stable/?badge=latest :alt: Documentation Status .. |Demo| image:: https://raw.githubusercontent.com/Parsely/streamparse/master/doc/source/images/quickstart.gif
Not written in Markdown, so it's shown here as plain text — view it formatted on GitHub.
1,883 followers · starred Sep 2014
373 followers · starred May 2014
422 followers · starred May 2014
65 followers · starred Feb 2016
Run Python in Apache Storm topologies. Pythonic API, CLI tooling, and a topology DSL.
See the code|logo| |Build Status| |Docs Status| Streamparse lets you run Python code against real-time streams of data via Apache Storm. With streamparse you can create Storm bolts and spouts in Python without having to write a single line of Java. It also provides handy CLI utilities for managing Storm clusters and projects. The Storm/streamparse combo can be viewed as a more robust alternative to Python worker-and-queue systems, as might be built atop frameworks like Celery and RQ. It offers a way to do "real-time map/reduce style computation" against live streams of data. It can also be a powerful way to scale long-running, highly parallel Python processes in production. |Demo| Documentation ------------- * `HEAD <http://streamparse.readthedocs.org/en/master/>`_ * `Stable <http://streamparse.readthedocs.org/en/stable/>`_ User Group ---------- Follow the project's progress, get involved, submit ideas and ask for help via our Google Group, `streamparse@googlegroups.com <https://groups.google.com/forum/#!forum/streamparse>`__. Contributors ------------ Alphabetical, by last name: - Dan Blanchard (`@dsblanch <https://twitter.com/dsblanch>`__) - Keith Bourgoin (`@kbourgoin <https://twitter.com/kbourgoin>`__) - Arturo Filastò (`@hellais <https://github.com/hellais>`__) - Jeffrey Godwyll (`@rey12rey <https://twitter.com/rey12rey>`__) - Daniel Hodges (`@hodgesds <https://github.com/hodgesds>`__) - Wieland Hoffmann (`@mineo <https://github.com/mineo>`__) - Tim Hopper (`@tdhopper <https://twitter.com/tdhopper>`__) - Omer Katz (`@thedrow <https://github.com/thedrow>`__) - Aiyesha Ma (`@Aiyesha <https://github.com/Aiyesha>`__) - Andrew Montalenti (`@amontalenti <https://twitter.com/amontalenti>`__) - Rohit Sankaran (`@roadhead <https://twitter.com/roadhead>`__) - Viktor Shlapakov (`@vshlapakov <https://github.com/vshlapakov>`__) - Mike Sukmanowsky (`@msukmanowsky <https://twitter.com/msukmanowsky>`__) - Cody Wilbourn (`@codywilbourn <https://github.com/codywilbourn>`__) - Curtis Vogt (`@omus <https://github.com/omus>`__) Changelog --------- See the `releases <https://github.com/Parsely/streamparse/releases>`__ page on GitHub. Roadmap ------- See the `Roadmap <https://github.com/Parsely/streamparse/wiki/Roadmap>`__. .. |logo| image:: https://raw.githubusercontent.com/Parsely/streamparse/master/doc/images/streamparse-logo.png .. |Build Status| image:: https://github.com/pystorm/streamparse/actions/workflows/test.yml/badge.svg :target: https://github.com/pystorm/streamparse/actions/workflows/test.yml :alt: Build Status .. |Docs Status| image:: https://readthedocs.org/projects/streamparse/badge/?version=latest :target: https://streamparse.readthedocs.io/en/stable/?badge=latest :alt: Documentation Status .. |Demo| image:: https://raw.githubusercontent.com/Parsely/streamparse/master/doc/source/images/quickstart.gif
Not written in Markdown, so it's shown here as plain text — view it formatted on GitHub.
1,883 followers · starred Sep 2014
373 followers · starred May 2014
422 followers · starred May 2014
65 followers · starred Feb 2016