Useful Java links

This is a fork of awesome link with new structure, additional license info and github's star info for every link, with a lot of new links (all non-mobile github projects with 390 or more star) and so on. The russian version is in this place.
The "Hello Worlds examples" project is in this place.

Useful java links

• I. Development

  • 1. Common frameworks and libraries
  • 2. Web development
  • 3. GUI
  • 4. Business
  • 5. Game Development
  • 6. Useful libraries
    • Collections
    • Date and Time
    • Dependency Injection and AOP
    • Console and Command line
    • Functional Programming
    • Reactive Programming
    • Security and Authentication
    • High Performance
    • Serialization and I/O
    • Logging
    • Bean Mapping and Validation
  • 7. Imagery and Video
  • 8. Code generation and changing byte code
  • 9. Distributed Applications
  • 10. Science
  • 11. OSGI

• II. Databases, search engines, big data and machine learning

  • 1. Databases and storages - Distributed Databases
  • 2. Data structures
  • 3. Search engines
  • 4. Client and drivers for databases
  • 5. ORM
  • 6. Working with messy data
  • 7. Big data
  • 8. Machine Learning - Semantic Web and Linked Data
    - Constraint Satisfaction Problem Solver - Natural Language Processing (NLP) and Speech Recognition

• III. Network and Integration

  • 1. Servers (Web Server and Application Server))
  • 2. Networking
  • 3. Message, message broker and message queue
  • 4. Http and ssh
  • 5. Rest Frameworks
  • 6. Integration frameworks
  • 7. Web Crawling and HTML parsering
  • 8. Json
  • 9. CSV
  • 10. Integratin with API
  • 11. Bitcoin
  • 12. Clouds
  • 13. Cluster Management
  • 14. Document Processing (XLS, DOC and PDF)
  • 15. Native
  • 16. XML and SOAP
  • 17. Geospatial Service Interation
  • 18. Reverse Proxy Servers

• IV. Testing

  • 1. Testing
  • 2. Code Coverage
  • 3. Continuous Integration
  • 4. Formal Verification

• V. Tools for developing

  • 1. IDE
  • 2. Deploy, config and build
    • Build
    • Configuration
    • Distribution
  • 3. Perfomance tools
  • 4. Code Analysis
  • 5. Monitoring
  • 6. Redefinition of classes at runtime
  • 7. Documentation
  • 8. Other

• VI. Program languages and applications that were written with Java

  • 1. Program languages that were written with Java
  • 2. Other program languages tools that were written with Java
  • 3. Javascript
  • 4. Frameworks that help to create parsers, interpreters or compilers
  • 5. Opensource applications that were written with Java
  • 6. Opensource games that were written with Java

• VII. Other

  • 1. Source code examples
  • 2. Benchmark results
  • 3. Working with git and github

• VIII. Resources

  • 1. Communities
  • 2. Influential Books
  • 3. Websites

I. Development

1. Common frameworks and libraries

Up

1. Spring framework The Spring Framework provides a comprehensive programming and configuration model for modern Java-based enterprise applications -- on any kind of deployment platform. A key element of Spring is infrastructural support at the application level: Spring focuses on the "plumbing" of enterprise applications so that teams can focus on application-level business logic, without unnecessary ties to specific deployment environments. License: Apache 2 , , stackoverflow - more 100 000 questions.
2. Google Guava The Guava project contains several of Google's core libraries that we rely on in our Java-based projects: collections, caching, primitives support, concurrency libraries, common annotations, string processing, I/O, and so forth.Requires JDK 1.6 or higher (as of 12.0). License: Apache 2 , .
3. Apache Commons - Apache Commons is an Apache project focused on all aspects of reusable Java components.Commons Proper is dedicated to one principal goal: creating and maintaining reusable Java components. License: Apache 2.
4. Spring Boot — Spring Boot makes it easy to create Spring-powered, production-grade applications and services with absolute minimum fuss. It takes an opinionated view of the Spring platform so that new and existing users can quickly get to the bits they need. License: Apache 2 , .
5. Lombok Very spicy additions to the Java programming language. Project Lombok makes java a spicier language by adding 'handlers' that know how to build and compile simple, boilerplate-free, not-quite-java code. License: MIT , .
6. Puniverse Quasar Fibers, Channels and Actors for the JVM. Hello World examples. License: Eclipse Public v1.0/GNU Lesser 3, .
7. Rootbeer GPU CompilerThe Rootbeer GPU Compiler lets you use GPUs from within Java. License: MIT , .
8. Oblac Jodd Jodd is set of open-source Java micro frameworks and tools; floppy size! Jodd = tools + ioc + mvc + db + aop + tx + json + html < 1.5 Mb. License: BSD 2, .
9. Google Jimfs An in-memory file system for Java 7+. License: Apache 2 , .
10. Spring batch Spring Batch is a framework for writing offline and batch applications using Spring and Java. License: Apache 2 , .
11. Microserver — A convenient Microservices plugin system for Spring & Spring Boot, with over 30 plugins and growing, that supports both micro-monolith and pure microservices styles. License: Apache 2 , .
12. Greenrobot common General purpose utilities and hash functions for Android and Java (aka java-common). License: Apache 2 , .
13. Kilim Lightweight threads for Java, with message passing, nio, http and scheduling support. License: MIT , .
14. Apache Isis Apache Isis is a framework for rapidly developing domain-driven apps in Java. Write your business logic in entities, domain services and repositories, and the framework dynamically (at runtime) generates a representation of that domain model as a webapp or as a RESTful API. For prototyping or production. License: Apache 2.
15. Apache Zest Apache Zest is a community based effort exploring Composite Oriented Programming for domain centric application development. This includes evolved concepts from Aspect Oriented Programming, Dependency Injection and Domain Driven Design. License: Apache 2.
16. Embedchain-JS Framework to easily create LLM powered bots over any dataset.

2. Web development

Up

Web Frameworks

1. Play Framework The Play Framework combines productivity and performance making it easy to build scalable web applications with Java and Scala. https://www.playframework.com/ . License: Apache 2 , .
2. Spark Spark - a Sinatra inspired web framework. License: Apache 2 , .
3. Blade a simple, elegant java web framework! License: Apache 2 , .
4. Atmosphere - Realtime Client Server Framework for the JVM, supporting WebSockets with Cross-Browser Fallbacks. License: CDDL1 / Apache 2 , .
5. Grails - Grails is a framework used to build web applications with the Groovy programming language. The core framework is very extensible and there are numerous plugins available that provide easy integration of add-on features. https://grails.org/ License: Apache 2 , .
6. Ninja Ninja is a full stack web framework for Java. Rock solid, fast and super productive. .http://www.ninjaframework.org. License: Apache 2 , .
7. Electronicarts Orbit — Orbit - Virtual actor framework for building distributed systems. License: BSD 3, .
8. Ratpack Ratpack is a simple, capable, toolkit for creating high performance web applications. Ratpack is built on Java and the Netty event-driven networking engine. The API is optimized for Groovy and Java 8.. https://ratpack.io/ License: Apache 2 , .
9. Vaadin — Vaadin is a Java framework for building modern web applications that look great, perform well and make you and your users happy.https://vaadin.com/ License: Apache 2 , .
10. ZK framework ZK is a highly productive Java framework for building amazing enterprise web and mobile applications. License: GNU Lesser, .
11. Apache Tapestry - A component-oriented framework for creating highly scalable web applications in Java. License: Apache 2.
12. Apache Wicket - Open Source Java web framework that powers thousands of web applications and web sites for governments, stores, universities, cities, banks, email providers, and more. License: Apache 2.
13. Google Web Toolkit - GWT is used by many products at Google, including Google AdWords and Google Wallet. It's open source, completely free, and used by thousands of enthusiastic developers around the world. License: Apache 2.
14. Pippo - It's an open source micro web framework in Java, with minimal dependencies and a quick learning curve.The goal of this project is to create a micro web framework in Java that should be easy to use and hack. Pippo can be used in small and medium applications and also in applications based on micro services architecture. License: Apache 2.
15. Spring MVC - Spring MVC web application and RESTful web service framework. License: Apache 2.
16. JavaServer Faces - JavaServer™ Faces technology simplifies building user interfaces for JavaServer applications. License: GNU 2 or CDDL 1.0
17. JavaServer Pages - This project provides a container independent implementation of JSP 2.1. License: GNU 2 or CDDL 1.0
18. Apache Cocoon Web development framework: separation of concerns, component-based. License: Apache 2.
19. Apache Struts Apache Struts is a free open-source framework for creating Java web applications. License: Apache 2.
20. Apache Sling Innovative Web framework based on JCR and OSGi. License: Apache 2.
21. Apache MyFaces The first free open source JavaServer(tm) Faces implementation. License: Apache 2.
22. Apache Pivot Apache Pivot is an open-source platform for building installable Internet applications (IIAs) [rich Internet application]. License: Apache 2.
23. Apache Turbine Turbine is a servlet based framework that allows Java developers to quickly build web applications. License: Apache 2.
24. Apache OODT Apache OODT software is component based, and offers a software architecture beyond simple science applications. License: Apache 2.
25. VRaptor VRaptor 4 delivers high productivity to your Java Web applications on top of CDI. VRaptor is an opensource MVC framework with a large developers and users community, . http://www.vraptor.org . License: Apache 2.
26. Jooby Scalable, fast and modular micro web framework for Java , . http://jooby.org/ . License: Apache 2.
27. CUBA Platform - High-level framework for developing enterprise applications with a rich web interface, based on Spring, EclipseLink and Vaadin. https://cuba-platform.com . License: Apache 2.
28. Jersey - Jersey RESTful Web Services framework is open source, production quality, framework for developing RESTful Web Services in Java that provides support for JAX-RS APIs and serves as a JAX-RS (JSR 311 & JSR 339) Reference Implementation.

Libraries for web development

1. Tobie ua-parser A multi-language port of Browserscope's user agent parser. License: Apache 2/MIT/Perl, .
2. Ghost Driver Ghost Driver is an implementation of the Remote WebDriver Wire protocol, using PhantomJS as back-end. License: BSD 2, .
3. B3log Solo - A blogging system written in Java, feel free to create your or your team own blog. License: Apache 2 , .
4. Nasher - A Spring Project with spring security support with angular admin panel. License: Apache 2 , .
5. Baasbox BaasBox is an Open Source project that aims to provide a backend for mobile and web apps. License: ?, .
6. Kolorobot Spring MVC 4 Quickstart Maven Archetype — The project is a Maven archetype for Spring MVC 4 web application. License: ?, .
7. Gargl - Record web requests as they happen and turn them into reusable code in any programming language. Gargl - Generic API Recorder and Generator Lite. Pronounced "Gargle." Automate any website. Record web requests as they happen and turn them into reusable code in any programming language. License: MIT , .
8. Liferay plugins - The liferay-plugins repository is part of the Liferay Portal project. Liferay Portal is an open source enterprise web platform for building business solutions that deliver immediate results and long-term value. License: GNU Lesser 2.1, .
9. Netflix Ribbon Ribbon is a Inter Process Communication (remote procedure calls) library with built in software load balancers. The primary usage model involves REST calls with various serialization scheme support. License: Apache 2 , .
10. Gwt bootstrap A GWT Library that provides the widgets of Bootstrap, from Twitter. License: Apache 2 , .
11. Netflix Zuul Zuul is an edge service that provides dynamic routing, monitoring, resiliency, security, and more. License: Apache 2 , .
12. PrimeFaces - PrimeUI is a pure CSS-JS library designed to work with any server side and client side technology featuring 50+ jQuery Widgets, Web Components, Premium Layouts-Themes and more. PrimeUI is an offspring project of the mighty PrimeFaces. License: Apache 2.
13. Spring Boot - Spring Boot makes it easy to create Spring-powered, production-grade applications and services with absolute minimum fuss. It takes an opinionated view of the Spring platform so that new and existing users can quickly get to the bits they need. License: Apache 2.
14. CSSEmbed A tool for embedding data URIs in CSS files. License: MIT , .
15. Athou commafeed Google Reader inspired self-hosted RSS reader. License: Apache 2 , .
16. Apache Any23 Anything To Triples (Any23) is a library, a web service and a command line tool that extracts structured data in RDF format from a variety of Web. License: Apache 2.
17. Apache Forrest Apache Forrest software is a publishing framework that transforms input from various sources into a unified presentation in one or more output formats. License: Apache 2.

Template Engine

1. Apache Velocity - Velocity is a project of the Apache Software Foundation, charged with the creation and maintenance of open-source software related to the Apache Velocity Engine (templating engine). License: Apache 2.
2. Apache FreeMarker - Apache FreeMarker is a template engine: a Java library to generate text output (HTML web pages, e-mails, configuration files, source code, etc.) based on templates and changing data. License: Apache 2.
3. Handlebars.java - Logic-less and semantic templates with Java, . License: Apache 2.
4. Thymeleaf - It is a template engine capable of processing and generating HTML, XML, JavaScript, CSS and text, and can work both in web and non-web environments. It is better suited for serving the view layer of web applications, but it can process files in many formats, even in offline environments. License: Apache 2.
5. Mustache.java - Implementation of mustache.js (web application templating system) for Java. License: Apache 2 , .
6. Apache Tiles Apache Tiles is a templating framework built to simplify the development of web application user interfaces. License: Apache 2.

CMS and content management

1. Apache Stanbol Software components for semantic content management. License: Apache 2.
2. Apache JSPWiki A feature-rich and extensible WikiWiki engine built around the standard J2EE components (Java, servlets, JSP). icense: Apache 2.
3. Apache Portals The Apache Portals project provides various software products, including Apache Jetspeed-2, Apache Pluto, and Apache Portals Applications. License: Apache 2.
4. Apache Roller Apache Roller is a full-featured, multi-user and group blog server suitable for blog sites large and small. License: Apache 2.
5. Apache Chemistry Apache Chemistry provides open source implementations of the Content Management Interoperability Services (CMIS) specification. License: Apache 2.
6. Jease Jease eases the development of content- & database-driven web-applications with Java. License: GPL v3.

3. GUI

1. JavaFX - JavaFX is the next step in the evolution of Java as a rich client platform. It is designed to provide a lightweight, hardware-accelerated Java UI platform for enterprise business applications. License: Oracle, proprietary.
2. Scene Builder - JavaFX Scene Builder is a visual layout tool that lets users quickly design JavaFX application user interfaces, without coding. Users can drag and drop UI components to a work area, modify their properties, apply style sheets, and the FXML code for the layout that they are creating is automatically generated in the background. The result is an FXML file that can then be combined with a Java project by binding the UI to the application’s logic. License: Oracle, proprietary. , but see Gluon Scene Builder.
3. Gluon Scene Builder - Scene Builder is free and open source JavaFX Scene Builder, but is backed by Gluon. Commercial support offerings are available, including training and custom consultancy services. License: BSD.
4. SWT - SWT is an open source widget toolkit for Java designed to provide efficient, portable access to the user-interface facilities of the operating systems on which it is implemented. License: Eclipse Public License v1.0.
5. Lanterna - Lanterna is a Java library allowing you to write easy semi-graphical user interfaces in a text-only environment, very similar to the C library curses but with more functionality. License: LGPL 2.1.
6. Gephi - Gephi is an award-winning open-source platform for visualizing and manipulating large graphs. It runs on Windows, Mac OS X and Linux. Localization is available in French, Spanish, Japanese, Russian, Brazilian Portuguese, Chinese and Czech. License: GNU 3 or CDDL 1.0.
7. Codename One - Open-source cross-platform app development solution for writing native apps for desktop, web & mobile in Java/Kotlin. (GPL + Classpath Exception)

4. Business

Up

1. Codecademy EventHub — An open source event analytics platform. License: MIT , .
2. Killbill - Open-Source Subscription Billing & Payment Platform . License: Apache 2 , .
3. Activiti Activiti is a light-weight workflow and Business Process Management (BPM) Platform targeted at business people, developers and system admins. Its core is a super-fast and rock-solid BPMN 2 process engine for Java. License: Apache 2 , .
4. Liferay Portal Liferay Portal is an open source enterprise web platform for building business solutions that deliver immediate results and long-term value. Liferay Portal started out as a personal development project in 2000 and was open sourced in 2001. License: GNU Lesser 2.1, .
5. Broadleaf Commerce - Broadleaf Commerce - Enterprise eCommerce framework based on Spring. License: Broadleaf Fair Use , .
6. Droolsjbpm Drools Drools Expert is the rule engine and Drools Fusion does complex event processing (CEP). License: Apache 2 , .
7. Spring Roo — Spring Roo is a next-generation rapid application development tool for Java developers. It focuses on higher productivity, stock-standard Java APIs, high usability, avoiding engineering trade-offs and facilitating easy Roo removal. License: Apache 2 , .
8. Apache OFBiz Apache OFBiz (The Apache Open For Business Project) is an open source enterprise automation software project. License: Apache 2.
9. Apache Portals The Apache Portals project provides various software products, including Apache Jetspeed-2, Apache Pluto, and Apache Portals Applications. License: Apache 2.
10. Apache ODE Apache ODE is a WS-BPEL implementation that supports web services orchestration using flexible process definitions. License: Apache 2.

5. Game Development

Up

1. libgdx Desktop/Android/HTML5/iOS Java game development framework. License: Apache 2 , .
2. Disunity An experimental toolset for Unity asset and asset bundle files. License: unlicense.org, .
3. LibGDX/LWJGL LibGDX/LWJGL tutorials and examples. License: ?, .
4. jMonkeyEngine A complete 3D game development suite written purely in Java.. https://jmonkeyengine.org/ License: BSD 3, .
5. Jetserver Jetserver is a high speed nio socket based multiplayer java game server written using Netty and Mike Rettig's Jetlang.It is specifically tuned for network based multiplayer games and supports TCP and UDP network protocols. License: MIT , .
6. LWJGL 2.X LWJGL 2.X - The Lightweight Java Game Library. https://www.lwjgl.org/ License: BSD 3, .
7. Ardor3D - JogAmp’s Ardor3D Continuation is a general-purpose, professionally oriented, open source, scenegraph based 3D Java engine for desktop and embedded environments, using JOGL for its hardware graphics acceleration. Fork of jMonkeyEngine 2.0. Cross-platform. License: zlib.
8. DimensioneX Multiplayer Engine - Produces browser games with pseudo-3D views. Games can be turned into Facebook Apps. Intended for beginners. 2.5D. Cross-platform. Notable games: Underworld Online. License: GPL
9. PlayN A Java game development framework that deploys to Windows, Linux, HTML5, Android and iOS. Notable games: Angry Birds Chrome. Cross-platform. License: Apache 2.0. .
10. Env3D - 3D game engine that creates an interface for dynamically adding EnvObjects. Built on jMonkeyEngine 2.0. Cross-platform License: GPL
11. Jake2 Java port of the Quake II game engine. 2D. Cross-platform License: GPL
12. Jogre - JOGRE (Java Online Gaming Real-time Engine) which is an open-source, online, real-time gaming engine and API programmed entirely in Java. License: GPL
13. Elflight Engine - Targeted for web based games. License: Proprietary
14. FXGL - JavaFX Game Development Framework. License: MIT, .

6. Useful libraries

Up

Collections

1. Google Guava The Guava project contains several of Google's core libraries that we rely on in our Java-based projects: collections, caching, primitives support, concurrency libraries, common annotations, string processing, I/O, and so forth.Requires JDK 1.6 or higher (as of 12.0). Hello World examples License: Apache 2 , .
2. Apache Commons Collections - Commons-Collections seek to build upon the JDK classes by providing new interfaces, implementations and utilities. Hello World examples. License: Apache 2.
3. Gs collections A supplement or replacement for the Java Collections Framework. Hello World examples. License: Apache 2 , .
4. Eclipse Collections Eclipse Collections is a collections framework for Java. It has JDK-compatible List, Set and Map implementations with a rich API, additional types not found in the JDK like Bags, Multimaps and set of utility classes that work with any JDK compatible Collections, Arrays, Maps or Strings. The iteration protocol was inspired by the Smalltalk collection framework.Eclipse Collections started off as an open source project on GitHub called GS Collections. GS Collections has been presented at the JVM Language Summit in 2012 and JavaOne in 2014. Hello World examples. License: Eclipse Public 1.0.
5. javatuples - javatuples is one of the simplest java libraries ever made. Its aim is to provide a set of java classes that allow you to work with tuples.A tuple is just a sequence of objects that do not necessarily relate to each other in any way. For example: [23, "Saturn", java.sql.Connection@li734s] can be considered a tuple of three elements (a triplet) containing an Integer, a String, and a JDBC Connection object. License: Apache 2.
6. Immutables - Java annotation processors to generate simple, safe and consistent value objects. Do not repeat yourself, try Immutables, the most comprehensive tool in this field. License: Apache 2.
7. OpenHFT Chronicle Queue Micro second messaging that stores everything to disk. License: GNU Lesser 3.0, .
8. fastutil - fastutil extends the Java™ Collections Framework by providing type-specific maps, sets, lists and queues with a small memory footprint and fast access and insertion; provides also big (64-bit) arrays, sets and lists, and fast, practical I/O classes for binary and text files. It requires Java 7 or newer. License: Apache 2.
9. HPPC - HPPC provides template-generated implementations of typical collections, such as lists, sets and maps, for all Java primitive types. The primary driving force behind HPPC is optimization for highest performance and memory efficiency. License: Apache 2.
10. Koloboke - Java Collections till the last breadcrumb of memory and performance . This library is a carefully designed and efficient extension of the Java Collections Framework with primitive specializations and more. Java 6+. License: Apache 2.
11. Trove - The Trove library provides high speed regular and primitive collections for Java. License: GNU Lesser 2.1.
12. underscore-java - Underscore-java is a java port of Underscore.js. In addition to porting Underscore's functionality, Underscore-java includes matching unit tests. License: MIT , .

Date and Time

1. Almanac Converter - An easy-to-use Java-based calendar converter - able to convert between various known calendars. License: Apache 2.
2. Joda-Time - Joda-Time provides a quality replacement for the Java date and time classes. License: Apache 2, .
3. ThreeTenBP - Backport of functionality based on JSR-310 to Java SE 6 and 7. This is NOT an implementation of JSR-310. License: BSD 3.
4. Time4J - Advanced date, time and interval library for Java. License: GNU Lesser 2.1.
5. Ocpsoft Prettytime Social Style Date and Time Formatting for Java.PrettyTime is an OpenSource time formatting library. Completely customizable, it creates human readable, relative timestamps like those seen on Digg, Twitter, and Facebook. Get started “right now!” and in over 30 languages! License: Apache 2 , .
6. threeten-extra Provides additional date-time classes that complement those in JDK 8. business-friendly BSD 3-clause license

Dependency Injection and AOP frameworks

1. Spring Framework The Spring Framework provides a comprehensive programming and configuration model for modern Java-based enterprise applications -- on any kind of deployment platform. A key element of Spring is infrastructural support at the application level: Spring focuses on the "plumbing" of enterprise applications so that teams can focus on application-level business logic, without unnecessary ties to specific deployment environments. Hello World examples. License: Apache 2 , .
2. Dagger and Dagger2 A fast dependency injector for Android and Java. Hello World examples. License: Apache 2 , , stackoverflow - 800 questions.
3. Google Guice - Guice (pronounced 'juice') is a lightweight dependency injection framework for Java 6 and above, brought to you by Google. Hello World examples. License: Apache 2, .
4. Apache DeltaSpike - DeltaSpike consists of a number of portable CDI extensions that provide useful features for Java application developers. We will also ensure true portability! We are testing DeltaSpike on different CDI implementations like Apache OpenWebBeans and JBoss Weld, and also on different Java EE servers like Apache Tomcat and TomEE, JBoss AS7, WildFly 8.x and 9.x, Oracle GlassFish 3.1+ and 4.x+, IBM WebSphere 8.x, Oracle WebLogic Server 12c, Jetty, and others. License: Apache 2
5. HK2 - A light-weight and dynamic dependency injection framework. GNU 2/ CDDL 1.0.
6. Eclipse AspectJ - AspectJ is a seamless aspect-oriented extension to the Java programming language, Java platform compatible, easy to learn and use. License: Eclipse Public 1.0.

Console and Command line

1. jcommander Command line parsing framework for Java. http://jcommander.org/ License: Apache 2 , .
2. Jline JLine is a Java library for handling console input. It is similar in functionality to BSD editline and GNU readline. People familiar with the readline/editline capabilities for modern shells (such as bash and tcsh) will find most of the command editing features of JLine to be familiar. License: BSD 4, .
3. args4j - args4j is a small Java class library that makes it easy to parse command line options/arguments in your CUI application. License: MIT
4. CRaSH - The shell for the Java Platform Open source and open minde. License: GNU Lesser 2.1
5. picocli - Annotation based command line parser with strong typing for both options and positional args and support for git-like subcommands. Usage help with ANSI colors. Easily included as source to avoid external dependencies. License: Apache 2

Functional Programming

Libraries that facilitate functional programming.

1. Retrolambda Backport of Java 8's lambda expressions to Java 7, 6 and 5. License: Apache 2 , .
2. Vavr - Vavr (formerly called Javaslang) is a functional library for Java 8+. It helps to reduce the amount of code and to increase the robustness. A first step towards functional programming is to start thinking in immutable values. Vavr provides immutable collections and the necessary functions and control structures to operate on these values, . License: Apache 2.
3. jOOλ - jOOλ - The Missing Parts in Java 8 jOOλ improves the JDK libraries in areas where the Expert Group's focus was elsewhere. It adds tuple support, function support, and a lot of additional functionality around sequential Streams, . License: Apache 2.
4. Functional Java - Functional Java is an open source library facilitating functional programming in Java. The library implements numerous basic and advanced programming abstractions that assist composition oriented development. Functional Java also serves as a platform for learning functional programming concepts by introducing these concepts using a familiar language. http://www.functionaljava.org License: BSD 3, .
5. Cyclops react - A comprehensive functional reactive platform for JDK8. Future & functional based programming via JDK compatible extensions for Java 8 and above, . License: MIT
6. Fugue -Java 8 has standardised some of the basic function interfaces, but does not include quite a few more tools that a functional programmer may expect to be available. This library attempts to fill in some of the gaps when using Java 8. In particular it provides Option and Either types as well as a Pair. There also additional helper classes for common Function, Supplier, and Iterable operations. License: Apache 2.
7. TotallyLazy Another functional library for Java , License: Apache 2, .
8. derive4j - Java 8 annotation processor and framework for deriving algebraic data types constructors, pattern-matching, morphisms, (near future: optics and typeclasses), . License: GNU 3.

Reactive Programming

Libraries for developing reactive applications.

1. ReactiveX RxJava RxJava – Reactive Extensions for the JVM – a library for composing asynchronous and event-based programs using observable sequences for the Java VM. License: Apache 2 , , stackoverflow - 1814 questions.
2. Eclipse Vert.x Vert.x is a tool-kit for building reactive applications on the JVM . License:  Eclipse Public 1 / Apache 2 , , stackoverflow - 728 questions.
3. Reactive Streams - The purpose of Reactive Streams is to provide a standard for asynchronous stream processing with non-blocking backpressure. License: Public Domain (CC0), .
4. Reactor - Reactor is a second-generation Reactive library for building non-blocking applications on the JVM based on the Reactive Streams Specification. License: Apache 2.
5. RSocket - RSocket is a binary protocol for use on byte stream transports such as TCP, WebSockets, and Aeron. License: Apache 2,

Security and Authentication

Libraries that handle security, authentication, authorization or session management. Up

1. OTP-Java - A small one-time password generator library according to RFC 4226 (HOTP) and RFC 6238 (TOTP). MIT
2. Scribe Java - Simple OAuth library for Java. License: MIT , .
3. Spring security oauth - Support for adding OAuth1(a) and OAuth2 features (consumer and provider) for Spring web applications. License: Apache 2 , .
4. Jasig CAS (Central Authentication Service) - Apereo CAS - Single Sign On for the Web.The Central Authentication Service (CAS) is the standard mechanism by which web applications should authenticate users. License: Apache 2 , .
5. Spring security — Spring Security provides security services for the Spring IO Platform. Spring Security 3.1 requires Spring 3.0.3 as a minimum and also requires Java 5. License: Apache 2 , .
6. Play Authenticate - An authentication plugin for Play Framework 2.x (Java). License: Apache 2 , .
7. Apache Shiro - Apache Shiro is a powerful and easy-to-use Java security framework that performs authentication, authorization, cryptography, and session management. With Shiro’s easy-to-understand API, you can quickly and easily secure any application – from the smallest mobile applications to the largest web and enterprise applications. License: Apache 2.
8. Bouncy Castle - Legion of the Bouncy Castle Java cryptography APIs.A lightweight cryptography API. License: MIT.
9. Cryptomator - Free client-side encryption for your cloud files. Open source software: No backdoors, no registration. License: MIT.
10. Google Keyczar - Easy-to-use crypto toolkit. License: Apache 2.
11. Keycloak - Integrated SSO and IDM for browser apps and RESTful web services. Built on top of the OAuth 2.0, Open ID Connect, JSON Web Token (JWT) and SAML 2.0 specifications. Keycloak has tight integration with a variety of platforms and has a HTTP security proxy service where we don't have tight integration. Options are to deploy it with an existing app server, as a black-box appliance, or as an Openshift cloud service and/or cartridge. License: Apache 2.
12. PicketLink - Simplified Security and Identity management for Java Applications PicketLink is an umbrella project for security and identity management for Java Applications. It is licensed under a friendly Apache v2 license. License: Apache 2.
13. Santuario Library implementing XML Digital Signature Specification & XML Encryption Specification. License: Apache 2.
14. Apache Oltu ( has retired ) Apache Oltu is an OAuth protocol implementation in Java. License: Apache 2.
15. Apache Syncope Apache Syncope is an Open Source system for managing digital identities in enterprise environments. License: Apache 2.
16. JObfuscator - JObfuscator is a source code obfuscator for the Java language to protect Java source code & algorithms from hacking, cracking, reverse engineering, decompilation & technology theft. License:
17. OpenAM - Access management solution that includes authentication, SSO, authorization, federation, entitlements and web services security. License: CDDL, .

High Performance

Everything about high performance computation, from collections to specific libraries. Up

1. Agrona - High Performance data structures and utility methods for Java and C++, License: Apache 2.
2. Disruptor - Inter-thread messaging library. License: Apache 2.
3. fastutil - fastutil extends the Java Collections Framework by providing type-specific maps, sets, lists and queues with a small memory footprint and fast access and insertion; provides also big (64-bit) arrays, sets and lists, and fast, practical I/O classes for binary and text files. License: Apache 2.
4. Eclipse Collections (older GS Collections) - Eclipse Collections is a collections framework for Java. It has JDK-compatible List, Set and Map implementations with a rich API and set of utility classes that work with any JDK compatible Collections, Arrays, Maps or Strings. The iteration protocol was inspired by the Smalltalk collection framework. The library modules in GS Collections are compatible with Java 5. License: Apache 2.
5. HPPC -HPPC provides template-generated implementations of typical collections, such as lists, sets and maps, for all Java primitive types. The primary driving force behind HPPC is optimization for highest performance and memory efficiency. License: Apache 2.
6. Javolution - ibrary for real-time and embedded systems. License: BSD 2.
7. JCTools - Concurrency tools currently missing from the JDK. License: Apache 2.
8. Koloboke - Hash sets and hash maps. License: Apache 2.
9. Trove - Primitive collections. License: GNU Lesser 2.1.
10. JUnion - Delivers struct types for Java programming language. 64 bit addressable struct arrays. https://tehleo.github.io/junion/ License: [License: BSD 3.

Serialization and I/O

Libraries that handle serialization with high efficiency. Up

1. Square Okio A modern I/O API for Java. License: Apache 2 , .
2. Square type A lightning fast, transactional, file-based FIFO for Android and Java. License: Apache 2 , .
3. Simple Binary Encoding (SBE) Simple Binary Encoding (SBE) - High Performance Message Codec. License: Apache 2 , .
4. MessagePack - MessagePack serializer implementation for Java. License: Apache 2 , .
5. FlatBuffers - Memory efficient serialization library that can access serialized data without unpacking and parsing it. License: Apache 2.
6. FST - JDK compatible high performance object graph serialization. License: Apache 2.
7. Kryo - Fast and efficient object graph serialization framework. License: BSD 3.

Logging

Libraries that log the behavior of an application. Up

1. Graylog2 server Free and open source log management. License: GNU 3, .
2. logback The reliable, generic, fast and flexible logging framework for Java.. http://logback.qos.ch/. License: Eclipse Public 1.0/GNU Lesser 2.1, .
3. slf4j Abstraction layer which is to be used with an implementation. http://www.slf4j.org/ License: MIT , .
4. Apache Log4j 2 - Apache Log4j 2 is an upgrade to Log4j that provides significant improvements over its predecessor. License: Apache 2.
5. graylog - Open-source aggregator suited for extended role and permission management. License: GNU 3.
6. Elastic Kibana - Analyzes and visualizes log files. Some features require payment. License: Apache 2.
7. Elastic Logstash - Tool for managing log files. License: Apache 2.
8. Metrics - Expose metrics via JMX or HTTP and can send them to a database. License: Apache 2.
9. tinylog - Lightweight logging framework with static logger class. License: Apache 2.

Bean Mapping and Validation

Frameworks that ease bean mapping or bean validation. Up

1. Dozer - Dozer is a Java Bean to Java Bean mapper that recursively copies data from one object to another. Hello World examples. License: Apache 2, .
2. MapStruct - An annotation processor for generating type-safe bean mappers. Hello World examples. License: Apache 2, .
3. ModelMapper -Simple, Intelligent, Object Mapping. Hello World examples. License: Apache 2, .
4. Orika - Simpler, better and faster Java bean mapping framework. Hello World examples. License: Apache 2, .
5. Selma - Stupid Simple Statically Linked Mapper. Hello World examples. Selma Java bean mapping that compiles. License: Apache 2, .
6. Apache BVal Apache BVal delivers an implementation of the Java Bean Validation (JSR303) Specification which is TCK compliant, works on Java SE 5 or later. License: Apache 2.
7. OVal – is a pragmatic and extensible validation framework for any kind of Java objects. Not JSR303/JSR380 compliant but supports Bean Validation constraints. It's pretty old flexible and reliable. License: EPL v2.0.

7. Imagery and Video

Libraries that assist with the creation, evaluation or manipulation of graphical images or video. Up

1. Facebook Rebound A Java library that models spring dynamics and adds real world physics to your app. License: BSD, .
2. Processing Source code for the Processing Development Environment (PDE) . License: GNU 2, .
3. JavaCV JavaCV uses wrappers from the JavaCPP Presets of commonly used libraries by researchers in the field of computer vision (OpenCV, FFmpeg, libdc1394, PGR FlyCapture, OpenKinect, videoInput, ARToolKitPlus, and flandmark), and provides utility classes to make their functionality easier to use on the Java platform, including Android. License: Apache 2 , .
4. imgscalr Simple Java image-scaling library implementing Chris Campbell's incremental scaling algorithm as well as Java2D's "best-practices" image-scaling techniques. License: Apache 2 , .
5. webcam-capture Project goal is to give users possibility to access build-in or connected via USB webcams or remote IP / network cameras directly from Java code. Using provided libraries user is able to read camera images and detect motion. License: MIT , .
6. Thumbnailator - Thumbnailator's fluent interface can be used to perform fairly complicated thumbnail processing task in one simple step.
7. zxing ZXing ("zebra crossing") is an open-source, multi-format 1D/2D barcode image processing library implemented in Java, with ports to other languages. License: Apache 2 , .

8. Code generation and changing byte code

Libraries to manipulate bytecode programmatically. Up

1. Google Auto - A collection of source code generators for Java. License: Apache 2 , .
2. Square Javapoet - JavaPoet is a Java API for generating .java source files. License: Apache 2 , .
3. Byte buddy - Runtime code generation for the Java virtual machine. http://bytebuddy.net/ License: Apache 2 , .
4. ASM - ASM is an all purpose Java bytecode manipulation and analysis framework. It can be used to modify existing classes or dynamically generate classes, directly in binary form. Provided common transformations and analysis algorithms allow to easily assemble custom complex transformations and code analysis tools. License: BSD 3 / License: Apache 2.
5. Byteman - Byteman is a tool which makes it easy to trace, monitor and test the behaviour of Java application and JDK runtime code. It injects Java code into your application methods or into Java runtime methods without the need for you to recompile, repackage or even redeploy your application. License: LGPL 2.1.
6. Javassist -Javassist (Java Programming Assistant) makes Java bytecode manipulation simple. It is a class library for editing bytecodes in Java; it enables Java programs to define a new class at runtime and to modify a class file when the JVM loads it. License: Apache 2 or LGPL or later 2.1 or Mozilla Public License 1.1..
7. ADT4J - This library implements Algebraic Data Types for Java. ADT4J provides annotation processor for @GenerateValueClassForVisitor annotation. ADT4J generates new class for each @GenerateValueClassForVisitor annotation. License: BSD 3.
8. JHipster - Hipster stack for Java developers. Spring Boot + AngularJS in one handy generator. License: Apache 2.
9. cglib - cglib - Byte Code Generation Library is high level API to generate and transform Java byte code. It is used by AOP, testing, data access frameworks to generate dynamic proxy objects and intercept field access. License: Apache 2.

9. Distributed Applications

Libraries and frameworks for writing distributed and fault-tolerant applications. Up

1. Akka - Akka is a toolkit and runtime for building highly concurrent, distributed, and resilient message-driven applications on the JVM. License: Apache 2.
2. Apache Storm - Apache Storm is a free and open source distributed realtime computation system. Storm makes it easy to reliably process unbounded streams of data, doing for realtime processing what Hadoop did for batch processing. Storm is simple, can be used with any programming language, and is a lot of fun to use! . License: Apache 2.
3. Twitter Heron - Heron is realtime analytics platform developed by Twitter. It is the direct successor of Apache Storm, built to be backwards compatible with Storm's topology API but with a wide array of architectural improvements. . http://heronstreaming.io License: Apache 2.
4. Apache ZooKeeper - ZooKeeper is a centralized service for maintaining configuration information, naming, providing distributed synchronization, and providing group services. All of these kinds of services are used in some form or another by distributed applications. License: Apache 2.
5. Alibaba Dubbo Dubbo is a distributed service framework empowers applications with service import/export capability with high performance RPC. License: Apache 2 , .
6. Netflix Curator ZooKeeper client wrapper and rich ZooKeeper framework. License: Apache 2 , .
7. Axon Framework - The axon framework is focussed on making life easier for developers that want to create a java application based on the CQRS principles. The framework is used in a lot of environments. License: Apache 2.
8. Hazelcast - The Leading Open Source In-Memory Data Grid: Distributed Computing, Simplified. License: Apache 2.
9. Netflix Hystrix - Hystrix is a latency and fault tolerance library designed to isolate points of access to remote systems, services and 3rd party libraries, stop cascading failure and enable resilience in complex distributed systems where failure is inevitable, . License: Apache 2.
10. JGroups - JGroups is a toolkit for reliable messaging. It can be used to create clusters whose nodes can send messages to each other. License: Apache 2.
11. Orbit - Orbit is a modern framework for JVM languages that makes it easier to build and maintain distributed and scalable online services. It was developed by BioWare, a division of Electronic Arts. License: BSD 3.
12. Quasar - Quasar is an open source JVM library that greatly simplifies the creation of highly concurrent software that is very easy to write and reason about, performant, and fault tolerant. License: Eclipse Public License v1.0 or LGPL 3.0.
13. Storm contrib A collection of spouts, bolts, serializers, DSLs, and other goodies to use with Storm. License: Eclipse Public 1.0, .
14. JADE - JADE (Java Agent DEvelopment Framework) is a software Framework fully implemented in the Java language. It simplifies the implementation of multi-agent systems through a middle-ware that complies with the FIPA specifications and through a set of graphical tools that support the debugging and deployment phases. License: GNU Lesser 2.0.
15. Apache River Apache River software provides a standards-compilani JINI service. License: Apache 2.
16. Apache Tuscany Apache Tuscany simplifies the task of developing SOA solutions by providing a comprehensive infrastructure for SOA development and management that is based on Service Component Architecture (SCA) standard. License: Apache 2.
17. Lagom - Reactive Microservices for the JVM. https://www.lightbend.com/lagom . License: Apache 2, .

10. Science

Libraries for scientific computing and analysis. Up

1. DataMelt - DataMelt is a free mathematics software for scientists, engineers and students. It can be used for numeric computation, statistics, symbolic calculations, data analysis and data visualization. License: GNU 3.
2. JGraphT - JGraphT is a free Java class library that provides mathematical graph-theory objects and algorithms. It runs on Java 2 Platform (requires JDK 1.7 or later). License: Eclipse Public License or LGPL 2.1.
3. JScience - Provides a set of classes to work with scientific measurements and units. License: BSD 2.
4. Michael Thomas Flanagan's Java Scientific Library General classes of a Java scientific and numerical library written by Michael Thomas Flanagan to support both his own research and his undergraduate programming courses and projects. License: only for non-commercial use.

11. OSGI

1. ACE Apache ACE is a software distribution framework that allows you to centrally manage and distribute software components, configuration data and other artifacts to target systems. It is built using OSGi and can be deployed in different topologies. The target systems are usually also OSGi based, but don't have to be. License: Apache 2.
2. Aries The Aries project consists of a set of pluggable Java components enabling an enterprise OSGi application programming model. License: Apache 2.
3. Felix OSGi framework implementation and related technologies. License: Apache 2.
4. Karaf Apache Karaf is an OSGi distribution for server-side applications. License: Apache 2.
5. Equinox OSGI framework implementation and related technologies. License: EPL
6. Eclipse Virgo OSGI based server that is designed to run enterprise Java applications and Spring-powered applications. License: EPL

II. Databases, search engines, big data and machine learning

1. Databases and storages

Everything which simplifies interactions with the database. Up

1. Thinkaurelius Titan - Titan is a highly scalable graph database optimized for storing and querying large graphs with billions of vertices and edges distributed across a multi-machine cluster. Titan is a transactional database that can support thousands of concurrent users, complex traversals, and analytic graph queries. License: Apache 2 , .
2. Apache Cassandra - Cassandra is a partitioned row store. Rows are organized into tables with a required primary key. License: Apache 2 , .
3. Orientdb OrientDB is the first Multi-Model DBMS with Document & Graph engine. OrientDB can run distributed (Multi-Master), supports SQL, ACID Transactions, Full-Text indexing, Reactive Queries and has a small memory footprint. OrientDB is licensed with Apache 2 license and the development is driven by OrientDB LTD and a worldwide Open Source community. License: Apache 2/CDDL 1/Eclipse Distribution 1.0, .
4. Neo4j — Neo4j is the world’s leading Graph Database. It is a high performance graph store with all the features expected of a mature and robust database, like a friendly query language and ACID transactions. License: GNU 3/ GNU AGPLv3, .
5. Mapdb MapDB provides concurrent Maps, Sets and Queues backed by disk storage or off-heap-memory. It is a fast and easy to use embedded Java database engine. http://www.mapdb.org/. License: Apache 2 , .
6. Voldemort An open source clone of Amazon's Dynamo. Voldemort is a distributed key-value storage system. License: Apache 2 , .
7. Alluxio (formerly Tachyon) Memory-Speed Virtual Distributed Storage System. License: Apache 2 , .
8. Opentsdb A scalable, distributed Time Series Database. License: GNU 3, .
9. Hazelcast Open Source In-Memory Data Grid. License: Apache 2 , .
10. Tinkerpop Blueprints A Property Graph Model Interface. It provides implementations, test suites, and supporting extensions. Graph databases and frameworks that implement the Blueprints interfaces automatically support Blueprints-enabled applications. Likewise, Blueprints-enabled applications can plug-and-play different Blueprints-enabled graph backends. License: BSD 3, .
11. Apache Lucene solr Apache Lucene/Solr. Lucene is a search engine library Solr is a search engine server that uses lucene. License: Apache 2 , .
12. Java Chronicle Java Indexed Record Chronicle — This library is an ultra low latency, high throughput, persisted, messaging and event driven in memory database. License: Apache 2 , .
13. Torodb ToroDB - Open source NoSQL database that runs on top of a RDBMS. Compatible with MongoDB protocol and APIs, but with support for native SQL, atomic operations and reliable and durable backends like PostgreSQL. License: GNU AGPLv3, .
14. Crate Crate.IO: The fast, scalable, easy to use SQL database with native full text search. https://crate.io/ .License: Apache 2 , .
15. Linkedin Pinot A realtime distributed OLAP datastore. Pinot is a realtime distributed OLAP datastore, which is used at LinkedIn to deliver scalable real time analytics with low latency. License: Apache 2 , .
16. Solandra Solandra is a real-time distributed search engine built on Apache Solr and Apache Cassandra. License: Apache 2 , .
17. Voltdb VoltDB is a horizontally-scalable, in-memory SQL RDBMS designed for applications that have extremely high read and write throughput requirements. License: GNU AGPLv3, .
18. Leveldb This is a rewrite (port) of LevelDB in Java. This goal is to have a feature complete implementation that is within 10% of the performance of the C++ original and produces byte-for-byte exact copies of the C++ code.. License: Apache 2 , .
19. Kairosdb KairosDB is a fast distributed scalable time series database written on top of Cassandra. License: Apache 2 , .
20. Linkedin Sensei Sensei is a distributed, elastic realtime searchable database. License: Apache 2 , .
21. Elephantdb Distributed database specialized in exporting key/value data from Hadoop. License: BSD 3, .
22. Apache Drill Apache Drill is a distributed MPP query layer that supports SQL and alternative query languages against NoSQL and Hadoop data storage systems. License: Apache 2 , .
23. Tinkerpop Rexster Rexster is a graph server that exposes any Blueprints graph through HTTP/REST and a binary protocol called RexPro. Extensions support standard traversal goals such as search, score, rank, and, in concert, recommendation. License: BSD 3, .
24. Tomcat redis session manager Redis-backed non-sticky session store for Apache Tomcat. License: MIT , .
25. Embulk Embulk is a parallel bulk data loader that helps data transfer between various storages, databases, NoSQL and cloud services. License: Apache 2 , .
26. H2 - Welcome to H2, the Java SQL database. The main features of H2 are: Very fast, open source, JDBC API, Embedded and server modes; in-memory databases, Browser based Console application,Small footprint: around 1.5 MB jar file size License: Mozilla Public License 1.1. and Eclipse Public License v1.0.
27. Apache Derby - Apache Derby, an Apache DB subproject, is an open source relational database implemented entirely in Java. Derby provides an embedded JDBC driver that lets you embed Derby in any Java-based solution. License: Apache 2.
28. Apache Empire-db Apache Empire-db is a lightweight relational database abstraction layer and data persistence component. License: Apache 2.
29. Apache Ignite Apache Ignite is an In-Memory Data Fabric providing in-memory data caching, partitioning, processing, and querying components. License: Apache 2.
30. Tarantool — is an open-source NoSQL database management system and Lua application server. It maintains databases in memory and ensures crash resistance with write-ahead logging. It includes a Lua interpreter and interactive console but also accepts connections from programs in several other languages. License: BSD licenses.

Distributed Databases.

Databases in a distributed system that appear to applications as a single data source.

1. Apache Cassandra - The Apache Cassandra database is the right choice when you need scalability and high availability without compromising performance. License: Apache 2 , .
2. Apache HBase - Apache HBase is an open-source, distributed, versioned, non-relational database modeled after Google's Bigtable: A Distributed Storage System for Structured Data by Chang et al. License: Apache 2.
3. Druid - Druid is a fast column-oriented distributed data store. http://druid.io License: Apache 2, .
4. Infinispan - Infinispan is a distributed in-memory key/value data store with optional schema. It can be used both as an embedded Java library and as a language-independent service accessed remotely over a variety of protocols (HotRod, REST, Memcached and WebSockets). License: Apache 2.
5. OpenTSDB - The Scalable Time Series Database Store and serve massive amounts of time series data without losing granularity. http://opentsdb.net License: GNU 3, .

2. Data structures

Efficient and specific data structures.

1. Apache Avro - Apache Avro is a data serialization system. License: Apache 2.
2. Apache Orc - The smallest, fastest columnar storage for Hadoop workloads. License: Apache 2.
3. Apache Parquet - Apache Parquet is a columnar storage format available to any project in the Hadoop ecosystem, regardless of the choice of data processing framework, data model or programming language. License: Apache 2.
4. Apache Thrift -The Apache Thrift software framework, for scalable cross-language services development, combines a software stack with a code generation engine to build services that work efficiently and seamlessly between C++, Java, Python, PHP, Ruby, Erlang, Perl, Haskell, C#, Cocoa, JavaScript, Node.js, Smalltalk, OCaml and Delphi and other languages. License: Apache 2.
5. Persistent Collection - PCollections serves as a persistent and immutable analogue of the Java Collections Framework. License: MIT.
6. Protobuf - Protocol Buffers (a.k.a., protobuf) are Google's language-neutral, platform-neutral, extensible mechanism for serializing structured data. License: BSD 3.
7. SBE - Simple Binary Encoding (SBE) - High Performance Message Codec, License: Apache 2.
8. Wire - Clean, lightweight protocol buffers for Android and Java. License: Apache 2.

3. Search engines

Up

1. Elasticsearch - Elasticsearch is a distributed RESTful search engine built for the cloud. License: Apache 2 , .
2. Linkedin Indextank Engine This project contains IndexTank (http://www.searchify.com) search engine implementation. Includes features like variables (boosts), categories (facets), faceted search, snippeting, custom scoring functions, suggest, and autocomplete. License: Apache 2 , .
3. Apache Solr Solr is the popular, blazing-fast, open source enterprise search platform built on Apache Lucene. http://lucene.apache.org/solr/ License: Apache 2 , .
4. Linkedin Cleo A flexible, partial, out-of-order and real-time typeahead search library. License: Apache 2 , .
5. Elasticsearch cloud aws AWS (Amazon Web Service) Cloud Plugin for Elasticsearch. License: Apache 2 , .
6. Elasticsearch analysis ik The IK Analysis plugin integrates Lucene IK analyzer into elasticsearch, support customized dictionary. License: ?, .
7. Apache ManifoldCF Open-source software for transferring content between repositories or search indexes License: Apache 2.
8. Lemur Project The Lemur Project develops search engines, browser toolbars, text analysis tools, and data resources that support research and development of information retrieval and text mining software, including the Indri search engine and ClueWeb09 dataset. License: BSD License
9. YaCy - The YaCy Search Engine application, http://yacy.net/ . License: GNU Lesser and GNU

4. Client and drivers for databases

Up

1. Facebook Presto Distributed SQL query engine for big data (Cassandra, Hive, Kafka, MySQL, PostgreSQL and so on). License: Apache 2 , .
2. Jedis A blazingly small and sane redis java client. License: MIT , .
3. Tinkerpop Gremlin A Graph Traversal Language. Gremlin is a domain specific language for traversing property graphs. Gremlin makes use of Pipes to perform complex graph traversals. This language has application in the areas of graph query, analysis, and manipulation. License: BSD 3 , .
4. Mongodb Java Driver The Java driver for MongoDB. License: Apache 2 / Creative Commons Attribution , .
5. Yahoo Mysql_perf_analyzer MySQL Performance Analyzer is an open source project for MySQL performance monitoring and analysis. License: Apache 2 , .
6. Airbnb Airpal Web UI for PrestoDB. License: Apache 2 , .
7. Mongodb hadoop MongoDB Connector for Hadoop. License: ?, .
8. Elasticsearch jdbc JDBC importer for Elasticsearch. License: Apache 2 , .
9. Flyway — Flyway by Boxfuse. Database Migrations Made Easy. https://flywaydb.org/ . License: Apache 2 , .
10. Elasticsearch river mongodb - MongoDB River Plugin for ElasticSearch. License: Apache 2 , .
11. Netflix Astyanax Cassandra Java Client. License: Apache 2 , .
12. Liquibase Liquibase — source control for your database, supports multiple developers, database types and so on. http://www.liquibase.org/ . License: Apache 2 , .
13. Mongodb Morphia MongoDB object-document mapper in Java based on. License: Apache 2 , .
14. Couchdb lucene Enables full-text searching of CouchDB documents using Lucene. License: Apache 2 , .
15. Forcedotcom Phoenix Phoenix is a SQL skin over HBase, delivered as a client-embedded JDBC driver, powering the HBase use cases at Salesforce.com. Phoenix targets low-latency queries (milliseconds), as opposed to batch operation via map/reduce. License: BSD 3 , .
16. Variety A schema analyzer for MongoDB. License: MIT , .
17. Redisson Redisson - distributed Java objects (Bloom filter, BitSet, Set, SetMultimap, ScoredSortedSet, SortedSet, Map, ConcurrentMap, List, ListMultimap, Queue, BlockingQueue, Deque, BlockingDeque, Semaphore, Lock, ReadWriteLock, AtomicLong, CountDownLatch, Publish / Subscribe, HyperLogLog), Redis pipelining on top of Redis server. License: Apache 2 , .
18. Netflix Priam Co-Process for backup/recovery, Token Management, and Centralized Configuration management for Cassandra. License: Apache 2 , .
19. Datastax Java driver DataStax Java Driver for Apache Cassandra. License: Apache 2 , .
20. Memcached Java Client to be the best java client for memcached. License: BSD 4, .
21. Spring data mongodb Provide support to increase developer productivity in Java when using MongoDB. Uses familiar Spring concepts such as a template classes for core API usage and lightweight repository style data access. License: Apache 2 , .
22. Apache Phoenix - Apache Phoenix enables OLTP and operational analytics in Hadoop for low latency applications by combining the best of both worlds, License: Apache 2.
23. FlexyPool - FlexyPool adds metrics and failover strategies to a given Connection Pool, allowing it to resize on demand. License: Apache 2.
24. LightAdmin - Pluggable data administration UI library for Java web applications. License: Apache 2.
25. Jaybird JCA/JDBC driver - JCA-JDBC Driver for Firebird database. http://www.firebirdsql.org/en/jdbc-driver/, . License: GNU Lesser 2.1.
26. dbeaver - Free universal database manager and SQL client. http://dbeaver.jkiss.org. , . License: GNU 2.
27. tarantool-java A Java client for Tarantool. License: BSD licenses.

5. ORM

APIs which handle the persistence of objects. Up

1. HikariCP A solid high-performance JDBC connection pool at last. License: Apache 2 , .
2. Mybatis 3 MyBatis SQL mapper framework for Java. License: Apache 2 , .
3. Hibernate orm Hibernate's core Object/Relational Mapping functionality. http://hibernate.org/orm/ License: GNU Lesser 2.1, .
4. JOOQ OOQ is an innovative solution for a better integration of Java applications with popular databases like Oracle, Microsoft SQL Server, IBM DB2, or SAP Sybase. http://www.jooq.org/ . License: Apache 2 , .
5. Querydsl Querydsl is a framework which enables the construction of type-safe SQL-like queries for multiple backends including JPA, MongoDB and SQL in Java. http://www.querydsl.com/ . License: Apache 2 , .
6. Kundera A JPA 2.1 compliant Polyglot Object-Datastore Mapping Library for NoSQL Datastores. License: Apache 2 , .
7. Spring data jpa Simplifies the development of creating a JPA-based data access layer. License: Apache 2 , .
8. Jdbi jDBI is designed to provide convenient tabular data access in Java(tm). It uses the Java collections framework for query results, provides a convenient means of externalizing sql statements, and provides named parameter support for any database being used. http://jdbi.org/ .License: Apache 2 , .
9. ActiveJDBC ActiveJDBC is a fast and lean Java ORM. License: Apache 2 , .
10. Vibur DBCP - Concurrent, fast, and fully-featured JDBC connection pool, which provides a non-starvation guarantee for application threads, statement caching, slow SQL queries detection and logging, and Hibernate integration, among other features. License: Apache 2.
11. Ebean - Ebean ORM for Java/Kotlin.Fast and simple data access on the JVM. License: Apache 2.
12. EclipseLink - Comprehensive open-source Java persistence solution addressing relational, XML, and database web services. License: Eclipse Public License v1.0 and BSD 3.
13. OrmLite - Object Relational Mapping Lite (ORM Lite) provides some simple, lightweight functionality for persisting Java objects to SQL databases while avoiding the complexity and overhead of more standard ORM packages. License: ISC.
14. Apache Cayenne User-friendly Java ORM with tools. License: Apache 2.
15. Apache OpenJPA Java Persistence API Implementation. License: Apache 2.
16. Apache MetaModel With MetaModel you get a uniform connector and query API to many very different datastore types, including: Relational (JDBC) databases, CSV files, Excel spreadsheets, XML files, JSON files, Fixed width files, MongoDB, Apache CouchDB, Apache HBase, Apache Cassandra, ElasticSearch, OpenOffice.org databases, Salesforce.com, SugarCRM and even collections of plain old Java objects (POJOs). License: Apache 2.

6. Working with messy data

Up

1. Storm - Distributed and fault-tolerant realtime computation: stream processing, continuous computation, distributed RPC, and more. License: Apache 2 , .
2. OpenRefine — OpenRefine is a free, open source power tool for working with messy data and improving it. License: BSD , .
3. Addthis Stream lib - Stream summarizer and cardinality estimator. License: Apache 2 , .
4. HdrHistogram (A High Dynamic Range (HDR) Histogram ) — HdrHistogram: A High Dynamic Range (HDR) Histogram: HdrHistogram supports the recording and analyzing of sampled data value counts across a configurable integer value range with configurable value precision within the range. License: BSD 2 , .
5. HazyResearch DeepDive DeepDive is a system to extract value from dark data. Like dark matter, dark data is the great mass of data buried in text, tables, figures, and images, which lacks structure and so is essentially unprocessable by existing software. License: Apache 2 , .
6. Apache Incubator Zeppelin Zeppelin, a web-based notebook that enables interactive data analytics. You can make beautiful data-driven, interactive and collaborative documents with SQL, Scala and more. License: Apache 2 , .
7. Seldon Server Enterprise machine learning platform for prediction and recommendation on Apache Spark. License: Apache 2 , .
8. Pulsar - Realtime analytics, this includes the core components of Pulsar pipeline. License: GNU 2.0, .
9. Suro: Netflix's Data Pipeline — Suro: Netflix's Data Pipeline. Suro is a data pipeline service for collecting, aggregating, and dispatching large volume of application events including log data. License: Apache 2 , .
10. Apache UIMA Annotator components and a scalable integration and deployment framework for Unstructured Information analysis. License: Apache 2.

7. Big data

Up

Frameworks and libraries for big data

1. Apache Storm - Storm is a distributed realtime computation system. Similar to how Hadoop provides a set of general primitives for doing batch processing, Storm provides a set of general primitives for doing realtime computation.License: Apache 2 , .
2. Twitter Heron - Heron is realtime analytics platform developed by Twitter. It is the direct successor of Apache Storm, built to be backwards compatible with Storm's topology API but with a wide array of architectural improvements. . http://heronstreaming.io License: Apache 2.
3. H2o h2o = fast statistical, machine learning & math runtime for bigdata. License: Apache 2 , .
4. Cloudera Oryx The Oryx open source project provides simple, real-time large-scale machine learning / predictive analytics infrastructure. It implements a few classes of algorithm commonly used in business applications: collaborative filtering / recommendation, classification / regression, and clustering. License: Apache 2 , .
5. Twitter Elephant bird - Twitter's collection of LZO and Protocol Buffer-related Hadoop, Pig, Hive, and HBase code. License: Apache 2 , .
6. Apache Hadoop - The Apache Hadoop software library is a framework that allows for the distributed processing of large data sets across clusters of computers using simple programming models. It is designed to scale up from single servers to thousands of machines, each offering local computation and storage. License: Apache 2 , .
7. Google Mr4c MR4C is an implementation framework that allows you to run native code within the Hadoop execution framework. License: GNU Lesser 3, .
8. Alibaba Jstorm — JStorm is a distributed and fault-tolerant realtime computation system. Inspired by Apache Storm, JStorm has been completely rewritten in Java and provides many more enhanced features. JStorm has been widely used in many enterprise environments and proved robust and stable. License: Apache 2 , .
9. Etsy Oculus Oculus is the anomaly correlation component of Etsy's Kale system. License: MIT , .
10. Linkedin Datafu Apache DataFu is a collection of libraries for working with large-scale data in Hadoop. The project was inspired by the need for stable, well-tested libraries for data mining and statistics. License: Apache 2 , .
11. Linkedin Gobblin Universal data ingestion framework for Hadoop. License: Apache 2 , .
12. Apache Flink - Apache Flink is an open source stream processing framework with powerful stream- and batch-processing capabilities. License: Apache 2 , .
13. Oryx 2 - Oryx 2: Lambda architecture on Apache Spark, Apache Kafka for real-time large scale machine learning. License: Apache 2 , .
14. Yahoo SAMOA (Scalable Advanced Massive Online Analysis) — SAMOA (Scalable Advanced Massive Online Analysis) is an open-source platform for mining big data streams. License: Apache 2 , .
15. Curator A set of Java libraries that make using Apache ZooKeeper much easier. License: Apache 2.
16. Apache Hama Hama is an efficient and scalable general-purpose BSP computing engine. License: Apache 2.
17. Apache Falcon Data management and processing platform for Hadoop. License: Apache 2.
18. Apache Knox A REST API Gateway for Hadoop Services. License: Apache 2.
19. Apache Flume Apache Flume is a distributed, reliable, and available system for efficiently collecting, aggregating and moving large amounts of log data from many different sources to a centralized data store. License: Apache 2.
20. Apache Tajo Tajo is an open source big data warehouse system in Hadoop for processing web-scale data sets. License: Apache 2.
21. Apache Tez Apache Tez is an effort to develop a generic application framework which can be used to process arbitrarily complex directed-acyclic graphs (DAGs) of data-processing tasks and also a re-usable set of data-processing primitives which can be used by other projects. License: Apache 2.
22. Apache REEF Apache REEF (Retainable Evaluator Execution Framework) is a scale-out computing fabric that eases the development of Big Data applications on top of resource managers such as Apache YARN and Mesos. License: Apache 2.
23. Apache Pig Apache Pig is a platform for analyzing large data sets on Hadoop. License: Apache 2.

Data store, database, search or SQL-like query engine for big data.

1. Druid Column oriented distributed data store ideal for powering interactive applications. License: Apache 2 , .
2. Apache Hive - The Apache Hive data warehouse software facilitates querying and managing large datasets residing in distributed storage. Built on top of Apache Hadoop. https://hive.apache.org/ .License: Apache 2 , .
3. Apache Kylin Apache Kylin is an open source Distributed Analytics Engine to provide SQL interface and multi-dimensional analysis (OLAP) on Hadoop supporting extremely large datasets. License: Apache 2 , .
4. Elasticsearch hadoop - Elasticsearch real-time search and analytics natively integrated with Hadoop. License: Apache 2 , .
5. Facebook Presto Presto is a distributed SQL query engine for big data. License: Apache 2 , .
6. Apache MetaModel With MetaModel you get a uniform connector and query API to many very different datastore types, including: Relational (JDBC) databases, CSV files, Excel spreadsheets, XML files, JSON files, Fixed width files, MongoDB, Apache CouchDB, Apache HBase, Apache Cassandra, ElasticSearch, OpenOffice.org databases, Salesforce.com, SugarCRM and even collections of plain old Java objects (POJOs). License: Apache 2.
7. Apache Accumulo Apache Accumulo is based on Google’s BigTable design and is built on top of Apache Hadoop, Zookeeper, and Thrift. Apache Accumulo features a few novel improvements on the BigTable design in the form of cell-based access control and a server-side programming mechanism that can modify key/value pairs at various points in the data management process. License: Apache 2.
8. Apache Gora provides an in-memory data model and persistence for big data. Gora supports persisting to column stores, key value stores, document stores and RDBMSs, and analyzing the data with extensive Apache Hadoop MapReduce support. License: Apache 2.
9. [Apache Sqoop] Apache Sqoop(TM) is a tool designed for efficiently transferring bulk data between Apache Hadoop and structured datastores such as relational databases.(http://sqoop.apache.org) License: Apache 2.
10. Giraph Apache Giraph is an iterative graph processing system built for high scalability. For example, it is currently used at Facebook to analyze the social graph formed by users and their connections. Лицензия: Apache 2.
11. Impala - Real-time Query for Hadoop. . License: Apache 2.

Monitoring, testing and managing tools for big data

1. Twitter Ambrose A platform for visualization and real-time monitoring of data workflows. License: Apache 2 , .
2. Umongo - Desktop app to browse and administer your MongoDB cluster. License: Apache 2 , .
3. Apache Ambari The Apache Ambari project is aimed at making Hadoop management simpler by developing software for provisioning, managing, and monitoring Apache Hadoop clusters. Ambari provides an intuitive, easy-to-use Hadoop management web UI backed by its RESTful APIs. License: Apache 2.
4. Apache Chukwa Chukwa is an open source data collection system for monitoring large distributed systems. Chukwa is built on top of the Hadoop Distributed File System (HDFS) and Map/Reduce framework and inherits Hadoop’s scalability and robustness. Chukwa also includes a flexible and powerful toolkit for displaying, monitoring and analyzing results to make the best use of the collected data. License: Apache 2.
5. Apache Bigtop Bigtop is an Apache Foundation project for Infrastructure Engineers and Data Scientists looking for comprehensive packaging, testing, and configuration of the leading open source big data components. License: Apache 2.
6. Apache BookKeeper BookKeeper is a replicated log service which can be used to build replicated state machines. A log contains a sequence of events which can be applied to a state machine. BookKeeper guarantees that each replica state machine will see all the same entries, in the same order. License: Apache 2.
7. Apache Crunch Provides a framework for writing, testing, and running MapReduce pipelines. License: Apache 2.
8. Apache MRUnit Apache MRUnit is a Java library that helps developers unit test Apache Hadoop map reduce jobs. License: Apache 2.
9. Apache Oozie Oozie is a workflow scheduler system to manage Apache Hadoop jobs. License: Apache 2.

8. Machine Learning

Tools that provide specific statistical algorithms which allow learning from data. Up

1. Airbnb Aerosolve A machine learning library designed from the ground up to be human friendly. License: Apache 2 , .
2. Smile Smile (Statistical Machine Intelligence and Learning Engine) is a set of pure Java libraries of various state-of-art machine learning algorithms. Smile is self contained and requires only Java standard library. Hello World examples. License: Apache 2 , .
3. Deeplearning4j Deeplearning4J is an Apache 2.0-licensed, open-source, distributed neural net library written in Java and Scala. http://deeplearning4j.org/ .License: Apache 2 , .
4. Libsvm Libsvm is a simple, easy-to-use, and efficient software for SVM classification and regression. It solves C-SVM classification, nu-SVM classification, one-class-SVM, epsilon-SVM regression, and nu-SVM regression. License: BSD 3, .
5. Neuralnetworks java deep learning algorithms and deep neural networks with gpu acceleration. License: MIT , .
6. Datumbox framework Datumbox is an open-source Machine Learning framework written in Java which allows the rapid development of Machine Learning and Statistical applications. License: Apache 2 , .
7. Apache Mahout The Apache Mahout project's goal is to build an environment for quickly creating scalable performant machine learning applications. https://mahout.apache.org/ .License: Apache 2 , .
8. Encog java core Encog is an advanced machine learning framework that supports a variety of advanced algorithms, as well as support classes to normalize and process data. Machine learning algorithms such as Support Vector Machines, Artificial Neural Networks, Genetic Programming, Bayesian Networks, Hidden Markov Models, Genetic Programming and Genetic Algorithms are supported. License: Apache 2 , .
9. Apache Flink - Apache Flink is an open source stream processing framework with powerful stream- and batch-processing capabilities. https://flink.apache.org/ Subproject: FlinkML - FlinkML is the Machine Learning (ML) library for Flink. License: Apache 2 , .
10. Apache Hadoop - The Apache Hadoop software library is a framework that allows for the distributed processing of large data sets across clusters of computers using simple programming models. It is designed to scale up from single servers to thousands of machines, each offering local computation and storage. http://hadoop.apache.org/ License: Apache 2 , .
11. Apache Spark - Apache Spark™ is a fast and general engine for large-scale data processing. Subproject: MLlib. License: [Apache 2](http://www.apache.org/licenses/LI