yeshenpy/Awesome-Evolutionary-Reinforcement-Learning

Research Papers and Code Repository on the Integration of Evolutionary Algorithms and Reinforcement Learning

390

102 commits

updated Aug 29, 2026

See the code

README

[!IMPORTANT] Official companion repository for Bridging Evolutionary Algorithms and Reinforcement Learning: A Comprehensive Survey on Hybrid Algorithms.
This repository helps readers enter the ERL field faster, reproduce representative methods, navigate the survey taxonomy, and track new papers and code. It currently indexes 270 canonical algorithm works and curates 86 independently reviewed Chinese and English guide mappings across 80 unique URLs, covering 54 works.

Official companion repository for the evolutionary reinforcement learning survey

Awesome Evolutionary Reinforcement Learning

The research companion for studying, reproducing, and extending ERL

Awesome Survey IEEE TEVC 86 verified bilingual reading-guide mappings Contributions welcome

Evolutionary Reinforcement Learning (ERL) combines the global search and population diversity of evolutionary algorithms with the learning efficiency and decision-making capabilities of reinforcement learning. Alongside papers and verified code, this collection provides independently reviewed 中文 / English explanations so readers can move quickly from the survey taxonomy to understanding, reproducing, and extending representative methods.

Read the survey · Browse the taxonomy · 中文 / English reading guides · Start from code · See recent work


Overview

3 major directions21 maintained branches270 canonical algorithm works80 with verified public code
EA → RL · RL → EA · SynergySurvey branches plus maintained extensions264 taxonomy works + 6 recent worksCanonical works with an exact code match

Reproducible count policy (30 Aug 2026): one canonical work equals one unique paper record, regardless of aliases, variants, or cross-listings. The 270 total excludes tooling/benchmarks, field overviews, and the independent watchlist. Code coverage counts canonical works with an exact author/official or explicitly labeled community implementation.

[!IMPORTANT] Which survey version should you use? Cite the IEEE version of record, read arXiv v5 for the latest paper content, and use this repository for code and ongoing updates. See the exact differences ↓

Choose a direction

01 · EA assists RL02 · RL assists EA03 · EA and RL collaborate
Evolution searches policies, actions, hyperparameters, curricula, or reward structures for RL.RL configures initialization, evaluation, variation, operator selection, and EA hyperparameters.Population search and gradient learning exchange information or optimize jointly.
Explore EA-assisted RL ↓Explore RL-assisted EA ↓Explore synergistic ERL ↓

Quick paths

Need reproducible baselines? Start from the code-first list and frameworks.
Need an explanation first? Start from the integrated bilingual reading-guide overview, then open the full work-by-work guide when you need a specific method.
Tracking the newest work? Go to recent and emerging directions.

[!NOTE] Code labels: repository links are author-maintained unless explicitly marked as a community implementation. Not found means no verified public implementation was located. Some methods are intentionally cross-listed when one mechanism contributes to multiple branches.

Changelog
  • 30 Aug 2026 — completed a multi-scope coverage adjudication: added 120 canonical works, expanded the collection to 270 papers and 80 verified code artifacts, corrected QD-PG metadata, and retained 14 independently tracked boundary items in a non-counting watchlist.
  • 29 Aug 2026 — refined the bilingual reading guide to 86 verified work-link mappings across 54 works after a stricter mechanism-depth audit removed mismatched and installation-only references.
  • 28 Aug 2026 — synchronized the collection with arXiv v5; added Reward Design, Dynamic Operator Selection, missing QD methods, recent 2024–2026 work, verified code repositories, frameworks, and updated taxonomy figures.
  • 26 Jul 2024 — the survey was accepted by IEEE Transactions on Evolutionary Computation.
Full section index

Bilingual reading guides

The reading guide is integrated into this repository as a second layer over the survey taxonomy: use the compact paths below to enter a direction quickly, then open the complete work-by-work guide for all reviewed resources.

270 works reviewed54 works covered27 with Chinese material45 with English material86 verified mappings
Full collectionAt least one guide中文讲解English guides80 unique URLs

Core marks substantial, work-specific explanations. Extended marks concise but mechanism-bearing overview sections, project documentation, thesis chapters, posters, or talk slides. Installation-only repositories, abstract restatements, and references that merely mention a method are excluded.

Guide coverage and mapping counts are deduplicated by canonical paper/work URL, language, guide URL, and Core/Extended label; aliases and cross-lists do not add mappings.

Research directionCoverageSuggested starting points
EA assists RL13 / 47 worksPBT · English · Go-Explore · 中文 · Qt-Opt · English
RL assists EA15 / 105 worksDeepACO · 中文 · LOOP · English · TD-MPC · 中文
EA and RL collaborate23 / 112 worksRACE · 中文 · Eureka · English · ROSKA · 中文
Recent directions3 / 6 worksFollow verified projects and author material in the full guide.

Browse the complete bilingual guide →

Taxonomy

Survey v5 organizes ERL into three major directions and sixteen research branches. The maintained repository uses twenty-one branches after adding five evidence-backed extensions: algorithm/update-rule discovery, quality-diversity, dynamic resource allocation, adaptive/staged/stabilized coupling, and representation/search decomposition.

ERL taxonomy

Figure 1. Taxonomy of evolutionary reinforcement learning in survey v5.

[!NOTE] Survey v5 Table V and the body text additionally include LERO under Reward Design and discuss XCSRG alongside XCSG. The detailed tables below follow the more complete body and tabular taxonomy.

Four integration approaches

Figure 2. Four integration patterns connecting EA and RL across solution and decomposed problem spaces.

Survey versions

VersionStatus and recommended use
Official published versionIEEE TEVC, Vol. 29, No. 5, pp. 1707–1728, 2025 · DOI
The peer-reviewed version of record. Use it for formal citation.
Current paper versionarXiv v5, revised 24 May 2026 · PDF
The author-updated manuscript with expanded method coverage. Use it for the latest survey content.
Current repository versionSynced 30 Aug 2026 with v5, multi-scope coverage adjudication, verified code links, frameworks, and a separately counted watchlist. Use it for implementation and tracking.

Difference at a glance: IEEE = archival citation · arXiv v5 = latest paper content · GitHub = maintained implementation index

The repository includes code availability, tooling, and newer work that should not be treated as part of the archival IEEE article.

Paper: Bridging Evolutionary Algorithms and Reinforcement Learning: A Comprehensive Survey on Hybrid Algorithms — Pengyi Li, Jianye Hao, Hongyao Tang, Xian Fu, Yan Zheng, and Ke Tang.

Code-first reading list

The following papers have public implementations verified against the paper, project page, or authors' repositories and are useful starting points. Community reimplementations are kept out of this short list and labeled explicitly in the full taxonomy.

Verified code-first collection (31 entries)
DirectionMethodPaperCodeGuide
EA-assisted RLSAC-CEPOSoft Actor-Critic with Cross-Entropy Policy Optimizationwcgcyx/SAC-CEPONot found
EA-assisted RLGRACGRAC: Self-Guided and Self-Regularized Actor-Criticstanford-iprl-lab/GRACEN · Extended
EA-assisted RLOMARPlan Better Amid Conservatism: Offline Multi-Agent Reinforcement Learning with Actor Rectificationling-pan/OMARNot found
EA-assisted RLSEARLSample-Efficient Automated Deep Reinforcement Learningautoml/SEARLEN · Extended
EA-assisted RLEvolving RL AlgorithmsEvolving Reinforcement Learning Algorithmsgoogle/brain_autorlEN 1 · Core
EN 2 · Core
EA-assisted RLGo-ExploreGo-Explore: a New Approach for Hard-Exploration Problemsuber-research/go-explore中文 1 · Core
中文 2 · Core
EN 1 · Core
EN 2 · Extended
EA-assisted RLROMANCERobust Multi-Agent Coordination via Evolutionary Generation of Auxiliary Adversarial Attackerszzq-bot/ROMANCENot found
EA-assisted RLEvILEvolution Strategies for Generalisable Imitation LearningSilviaSapora/evilEN · Extended
RL-assisted EADeepACODeepACO: Neural-Enhanced Ant Systems for Combinatorial Optimizationhenry-yeh/DeepACO中文 1 · Core
中文 2 · Core
EN · Extended
RL-assisted EACEM-RLCombining Evolutionary and Gradient-Based Methods for Policy Searchapourchot/CEM-RL中文 · Extended
EN · Extended
RL-assisted EAPGA-MEPolicy Gradient Assisted MAP-Elitesollebompa/PGA-MAP-ElitesEN · Extended
RL-assisted EACMA-MEGAApproximating Gradients for Differentiable Quality Diversity in Reinforcement Learningicaros-usc/dqd-rlEN 1 · Extended
EN 2 · Extended
RL-assisted EACCQDSample-Efficient Quality-Diversity by Cooperative Coevolutionlamda-bbo/CCQDNot found
RL-assisted EARefQDQuality-Diversity with Limited Resourceslamda-bbo/RefQDEN · Extended
RL-assisted EAWujiAutomatic Online Combat Game Testing Using Evolutionary Deep Reinforcement LearningNeteaseFuxiRL/wuji中文 · Core
SynergisticERLEvolution-Guided Policy Gradient in Reinforcement LearningShawK91/Evolutionary-Reinforcement-LearningEN 1 · Extended
EN 2 · Extended
SynergisticCERLCollaborative Evolutionary Reinforcement Learningintel/cerlEN · Core
SynergisticPDERLProximal Distilled Evolutionary Reinforcement Learningcrisbodnar/pderl中文 · Extended
SynergisticERL-Re2ERL-Re^2: Efficient Evolutionary Reinforcement Learning with Shared State Representation and Individual Policy Representationyeshenpy/ERL-Re2中文 · Core
EN · Extended
SynergisticVEB-RLValue-Evolutionary-Based Reinforcement Learningyeshenpy/VEB-RL中文 · Core
EN · Extended
SynergisticEvoRainbowEvoRainbow: Combining Improvements in Evolutionary Reinforcement Learning for Policy Searchyeshenpy/EvoRainbow中文 · Core
EN · Extended
SynergisticRACERACE: Improve Multi-Agent Reinforcement Learning with Representation Asymmetry and Collaborative Evolutionyeshenpy/RACE中文 · Core
EN · Extended
SynergisticCORECORE: Collaborative Optimization with Reinforcement Learning and Evolutionary Algorithm for Floorplanningyeshenpy/CORE中文 · Core
EN · Extended
Reward designEurekaHuman-Level Reward Design via Coding Large Language Modelseureka-research/Eureka中文 1 · Core
中文 2 · Core
EN 1 · Core
EN 2 · Extended
Reward designDrEurekaLanguage Model Guided Sim-to-Real Transfereureka-research/dreurekaEN · Extended
Reward designLaResLaRes: Evolutionary Reinforcement Learning with LLM-Based Adaptive Reward Searchyeshenpy/LaRes中文 · Core
EN · Extended
MorphologyEvoGymEvolution Gym: A Large-Scale Benchmark for Evolving Soft RobotsEvolutionGym/evogym中文 1 · Core
中文 2 · Core
EN 1 · Core
EN 2 · Extended
MorphologyHERDLeveraging Hyperbolic Embeddings for Coarse-to-Fine Robot Designdrdh/HERDEN · Extended
MorphologyAIEARapidly Evolving Soft Robots via Action InheritanceHandingWangXDGroup/AIEANot found
MorphologyDERLEmbodied Intelligence via Learning and Evolutionagrimgupta92/derl中文 · Core
EN 1 · Core
EN 2 · Extended
MorphologyTAMETask-Agnostic Morphology Evolutionjhejna/morphology-optNot found

EA-assisted Optimization of RL

EA → RL · Evolutionary search supports reinforcement learning while RL remains responsible for solving the task.

↑ Overview · Next: RL-assisted EA →

EA-assisted Action Selection

Browse all 11 methods

Hyperparameter Optimization

Algorithm and Update-rule Discovery

Other EA-assisted RL methods

Browse all 18 methods
MethodPaperVenueCodeGuide
GP-MAXQEvolutionary Development of Hierarchical Learning StructuresIEEE TEVC 2007Not foundEN · Extended
PNS-RLPNS: Population-Guided Novelty Search for Reinforcement Learning in Hard Exploration EnvironmentsIROS 2021Not foundNot found
Go-ExploreGo-Explore: a New Approach for Hard-Exploration ProblemsarXiv 2019, rev. 2021uber-research/go-explore中文 1 · Core
中文 2 · Core
EN 1 · Core
EN 2 · Extended
G2NGenetic-Gated Networks for Deep Reinforcement LearningNeurIPS 2018Not foundNot found
EVO-RLEvolutionary-Driven Reinforcement LearningGECCO 2021Not foundNot found
ROMANCERobust Multi-Agent Coordination via Evolutionary Generation of Auxiliary Adversarial AttackersAAAI 2023zzq-bot/ROMANCENot found
MA3CCommunication-robust multi-agent learning by adaptable auxiliary multi-agent adversary generationFrontiers of Computer Science 2024Not found中文 · Extended
EPCEvolutionary Population Curriculum for Scaling Multi-Agent RLICLR 2020qian18long/epciclr2020EN · Extended
MAPPERMAPPER: Multi-Agent Path Planning with Evolutionary Reinforcement Learning in Mixed Dynamic EnvironmentsIROS 2020Not found中文 · Extended
EvILEvolution Strategies for Generalisable Imitation LearningICML 2024SilviaSapora/evilEN · Extended
Behaviour Distillation (HaDES)Behaviour DistillationICLR 2024FLAIROx/behaviour-distillationNot found
Adversarial Cheap Talk (ACT)Adversarial Cheap TalkICML 2023luchris429/adversarial-cheap-talkNot found
GP Offline DataUsing genetic programming to improve data collection for offline reinforcement learningSwarm and Evolutionary Computation 2025Not foundNot found
EDT Curriculum GoalsHindsight Experience Replay with Evolutionary Decision Trees for Curriculum Goal GenerationEvoApplications 2024Not foundNot found
GA Offline Dataset ReductionDataset Reduction for Offline Reinforcement Learning using Genetic Algorithms with Image-Based HeuristicsGECCO 2025Not foundNot found
AEIRLAdaptive Evolutionary Inverse Reinforcement Learning for Large-Scale Interconnected SystemsNeurocomputing 2026Not foundNot found
ES-KD-MARLEvolutionary Sampling for Knowledge Distillation in Multi-Agent Reinforcement LearningMathematics 2025Not foundNot found
E2CLEfficient Evolutionary Curriculum Learning for Scalable Multi-Agent Reinforcement LearningJournal of King Saud University: Computer and Information Sciences 2025Not foundNot found

RL-assisted Optimization of EA

RL → EA · Reinforcement learning configures or improves one or more stages of an evolutionary algorithm.

← EA-assisted RL · ↑ Overview · Next: Synergistic ERL →

Population Initialization

Population Evaluation

This branch contains seven primary RL-assisted evaluation works plus three secondary mechanism cross-lists. SC, PGPS, and ERL-Re2 remain counted only under their synergistic canonical branches.

MethodPaperVenue / primary listingCodeGuide
SCA Surrogate-Assisted Controller for Expensive Evolutionary Reinforcement LearningSingle-Agent OptimizationYuxing-Wang-THU/Surrogate-assisted-ERL中文 · Extended
EN · Extended
PGPSCoupling Policy Gradient with Population-Based SearchSingle-Agent OptimizationNot foundNot found
ERL-Re2ERL-Re^2: Efficient Evolutionary Reinforcement Learning with Shared State Representation and Individual Policy RepresentationRepresentation and Search Decompositionyeshenpy/ERL-Re2中文 · Core
EN · Extended
Policy Embedding Surrogate ERLEnabling Surrogate-Assisted Evolutionary Reinforcement Learning via Policy EmbeddingBIC-TA 2022Not foundNot found
Neuroevolution SurrogatesSurrogate Models for Enhancing the Efficiency of Neuroevolution in Reinforcement LearningGECCO 2019Not foundNot found
Policy RacingHoeffding and Bernstein Races for Selecting Policies in Evolutionary Direct Policy SearchICML 2009Not foundNot found
Efficient ERL EvaluationAn Efficient Evaluation Mechanism for Evolutionary Reinforcement LearningLNCS 2022Not foundNot found
Hybrid SA-EMORLHybrid Surrogate Assisted Evolutionary Multiobjective Reinforcement Learning for Continuous Robot ControlEvoApplications 2024Not foundNot found
SA-EMARLSurrogate-Assisted Evolutionary Multi-Agent Reinforcement Learning with Adaptive Fitness EvaluationGECCO 2026Not foundNot found
DRL-SMMDeep Reinforcement Learning Assisted Surrogate Model Management for Expensive Constrained Multi-Objective OptimizationSwarm and Evolutionary Computation 2025Not foundNot found

Variation Operator

Browse all 8 canonical works

Quality-Diversity

Browse all 15 canonical works
MethodPaperVenueCodeGuide
NS-RLEfficient Novelty Search through Deep Reinforcement Learningshilx001/NoveltySearch_Improvement中文 · Extended
QD-PGDiversity Policy Gradient for Sample Efficient Quality-Diversity OptimizationGECCO 2022Not found中文 · Extended
PGA-MEPolicy Gradient Assisted MAP-ElitesGECCO 2021ollebompa/PGA-MAP-ElitesEN · Extended
GAC QD-RLUnderstanding the Synergies between Quality-Diversity and Deep Reinforcement LearningPreprint 2023Not foundNot found
CMA-MEGAApproximating Gradients for Differentiable Quality Diversity in Reinforcement LearningGECCO 2022icaros-usc/dqd-rlEN 1 · Extended
EN 2 · Extended
CCQDSample-Efficient Quality-Diversity by Cooperative CoevolutionICLR 2024lamda-bbo/CCQDNot found
RefQDQuality-Diversity with Limited ResourcesGECCO 2024lamda-bbo/RefQDEN · Extended
QDHUACDistributional Value Estimation Without Target Networks for Robust Quality-DiversityGECCO 2026 Full PaperNot foundNot found
EDOCSEvolutionary Diversity Optimization with Clustering-based Selection for Reinforcement LearningICLR 2022official code pageNot found
DvDEffective Diversity in Population Based Reinforcement LearningNeurIPS 2020jparkerholder/DvD_ESNot found
QD-SimQuality-Similar Diversity via Population Based Reinforcement LearningICLR 2023Not foundNot found
NS-ESImproving Exploration in Evolution Strategies for Deep Reinforcement Learning via a Population of Novelty-Seeking AgentsNeurIPS 2018Not foundNot found
CCNCS-ERLEvolutionary Reinforcement Learning via Cooperative Coevolutionary Negatively Correlated SearchSwarm and Evolutionary Computation 2022Not foundNot found
DBBD-ERLEvolutionary reinforcement learning with density-based behavioral diversity enhancement for berth allocation and crane assignmentSwarm and Evolutionary Computation 2026Not foundNot found
QDRL-BRPGQuality-Diversity Reinforcement Learning using Behavior Regulated Policy GradientACM TELO 2026Not foundNot found

Dynamic Operator Selection

This branch was empty in the previous README. Survey v5 identifies sixteen methods.

Browse all 30 methods
MethodPaperVenueCodeGuide
RL-GA(a)Controlling Genetic Algorithms with Reinforcement LearningGECCO 2002Not foundNot found
RLEPAdaptive Evolutionary Programming Based on Reinforcement LearningInformation Sciences 2008Not foundNot found
EA+RLIncreasing Efficiency of Evolutionary Algorithms by Choosing between Auxiliary Fitness Functions with Reinforcement LearningICMLA 2012Not foundNot found
EA+RL(O)Selecting Evolutionary Operators Using Reinforcement Learning: Initial ExplorationsGECCO 2014Not foundNot found
RL-GA(b)RL-GA: A Reinforcement Learning-Based Genetic Algorithm for Electromagnetic Detection Satellite Scheduling ProblemSwarm and Evolutionary Computation 2023Not foundNot found
GSFAutomated Design of Metaheuristics Using Reinforcement Learning within a Novel General Search FrameworkIEEE TEVC 2023Not foundNot found
MARLwCMAEvolutionary Framework with Reinforcement Learning-Based Mutation AdaptationIEEE Access 2020Not foundNot found
MPSORLMulti-strategy self-learning particle swarm optimization algorithm based on reinforcement learningMathematical Biosciences and Engineering 2023Not foundNot found
DEDQNDifferential Evolution with Mixed Mutation Strategy Based on Deep Reinforcement LearningApplied Soft Computing 2021Not foundNot found
DE-DDQNDeep Reinforcement Learning Based Parameter Control in Differential EvolutionGECCO 2019Not foundNot found
RL-CORCOConstrained Evolutionary Optimization Based on Reinforcement Learning Using the Objective Function and ConstraintsKnowledge-Based Systems 2022Not foundNot found
RL-HDEReinforcement Learning-Based Hybrid Differential Evolution for Global Optimization of Interplanetary Trajectory DesignSwarm and Evolutionary Computation 2023Not foundNot found
DE-RLFRDifferential evolution based on reinforcement learning with fitness ranking for solving multimodal multiobjective problemsSwarm and Evolutionary Computation 2019Not foundNot found
LRMODEA Fitness Landscape Ruggedness Multiobjective Differential Evolution Algorithm with a Reinforcement Learning StrategyApplied Soft Computing 2020Not foundNot found
MOEA/D-DQNDeep Reinforcement Learning Based Adaptive Operator Selection for Evolutionary Multi-Objective OptimizationIEEE TETCI 2023Not foundNot found
AMODE-DRLScheduling of Continuous Annealing with a Multi-Objective Differential Evolution Algorithm Based on Deep Reinforcement LearningIEEE T-ASE 2024Not foundNot found
DRL-AEOSFA Deep Reinforcement Learning-Assisted Evolutionary Operator Selection Framework for Constrained Optimization ProblemsSwarm and Evolutionary Computation 2026Not foundNot found
DRL-EMSDeep Reinforcement Learning Based Environmental and Mating Selection for Evolutionary Multi-objective OptimizationGECCO 2026Not foundNot found
DRL-MM-MOEAA Deep Reinforcement Learning-Guided Multimodal Multi-Objective Evolutionary Algorithm with a Serial-Parallel MechanismExpert Systems with Applications 2026Not foundNot found
RL-HH-OESA Reinforcement Learning Hyper-Heuristic for Opposition-Enhanced Shuffled Multi-Strategy Evolutionary Algorithms with Adaptive Population SizingApplied Intelligence 2026official data and MATLAB codeNot found
AOS-RLAdaptive Operator Selection with Reinforcement LearningInformation Sciences 2021Not foundNot found
OVEAA Reference Vector Based Multiobjective Evolutionary Algorithm with Q-Learning for Operator AdaptationSwarm and Evolutionary Computation 2023Not foundNot found
RLDMDEDynamic Multi-Strategy Integrated Differential Evolution Algorithm Based on Reinforcement Learning for Optimization ProblemsComplex & Intelligent Systems 2024Not foundNot found
RL-AOS RuntimeRuntime Analysis of Adaptive Selection Variation Operators in Evolutionary Algorithm with Reinforcement LearningApplied Intelligence 2025Not foundNot found
GEA-AOSAdaptive Operator Selection in Heuristic Optimization Utilizing Generalized Experience with Reinforcement LearningInternational Journal of Parallel, Emergent and Distributed Systems 2025Not foundNot found
TL-AOSTransfer Learning for Operator Selection: A Reinforcement Learning ApproachAlgorithms 2022Not foundNot found
CEDE-DRLDeep Reinforcement Learning Assisted Co-Evolutionary Differential Evolution for Constrained OptimizationSwarm and Evolutionary Computation 2023Not foundNot found
DRL-AOS-CMOConstrained Multi-Objective Optimization With Deep Reinforcement Learning Assisted Operator SelectionIEEE/CAA Journal of Automatica Sinica 2024Not foundNot found
RL-CMTOA Reinforcement Learning Assisted Evolutionary Algorithm for Constrained Multi-Task OptimizationInformation Sciences 2024Not foundNot found
DRL-AOPDeep Reinforcement Learning-Assisted Automated Operator Portfolio for Constrained Multi-Objective OptimizationIEEE TETCI 2026Not foundNot found

Dynamic Algorithm Configuration

This maintained branch extends the survey's hyperparameter-configuration grouping to cover learned, state-dependent algorithm configuration. Survey v5 contains AGA, LTO, RL-DAC, REM, Q-LSHADE & DQ-HSES, MADAC, qlDE, and RLDE; GS-DAC is the round-2 addition.

Browse all 29 canonical works
MethodPaperVenueCodeGuide
AGAReinforcement Learning for Online Control of Evolutionary AlgorithmsNot foundNot found
LTOLearning Step-Size Adaptation in CMA-ESautoml/LTO-CMAEN · Extended
RL-DACDynamic Algorithm Configuration: Foundation of a New Meta-Algorithmic Frameworkautoml/DACEN · Extended
REMVariational Reinforcement Learning for Hyper-Parameter Tuning of Adaptive Evolutionary AlgorithmNot foundNot found
MADACMultiagent Dynamic Algorithm Configurationlamda-bbo/madacEN · Extended
Q-LSHADE & DQ-HSESControlling Sequential Hybrid EA by Q-Learningofficial codeNot found
qlDEQ-Learning-Based Parameter Control in Differential Evolution for Structural OptimizationNot foundNot found
RLDEReinforcement Learning-Based Differential Evolution for Parameters Extraction of Photovoltaic ModelsNot foundNot found
GS-DACGraph-Supported Dynamic Algorithm Configuration for Multi-Objective Combinatorial OptimizationICML 2025RobbertReijnen/GS-MODACNot found
ERLA-HBSAn Adaptive Evolutionary-Reinforcement Learning Algorithm for Hyperspectral Band SelectionExpert Systems with Applications 2024Not foundNot found
ConfigXConfigX: Modular Configuration for Evolutionary Algorithms via Multitask Reinforcement LearningAAAI 2025MetaEvo/ConfigXNot found
DRL-EA-CMOAutomated Configuration of Evolutionary Algorithms via Deep Reinforcement Learning for Constrained Multiobjective OptimizationIEEE TCYB 2025Not foundNot found
RL-MS-ECMOReinforcement Learning-Assisted Multi-Stage Evolutionary Constrained Multi-Objective OptimizationACM TELO 2025Not foundNot found
AC-RL-MMOIntegrating Actor-Critic Reinforcement Learning With Evolutionary Algorithm for Multimodal Multiobjective OptimizationIEEE TNNLS 2026Not foundNot found
RL-MMOFA Hybrid Evolutionary Framework Assisted by Reinforcement Learning for Mixed Multi-Objective Optimization FeaturesApplied Soft Computing 2026Not foundNot found
RL-EA HelicopterReinforcement Learning-Enhanced Evolutionary Algorithm for Multi-Objective Optimal Control of a Laboratory HelicopterSwarm and Evolutionary Computation 2026Not foundNot found
SuperDEDeep Reinforcement Learning-Assisted Component Auto-Configuration of Differential Evolution Algorithm for Constrained Optimization: A Foundation ModelIEEE TEVC 2026Not foundNot found
MetaMTOLearning Where, What and How to Transfer: A Multi-Role Reinforcement Learning Approach for Evolutionary MultitaskingIEEE TEVC 2026Not foundNot found
LDELearning Adaptive Differential Evolution Algorithm From Optimization Experiences by Policy GradientIEEE TEVC 2021yierh/LDENot found
RL-HPSDEDifferential Evolution with Hybrid Parameters and Mutation Strategies Based on Reinforcement LearningSwarm and Evolutionary Computation 2022Not foundNot found
RLDE-AFLReinforcement Learning-Based Self-Adaptive Differential Evolution Through Automated Landscape Feature LearningGECCO 2025MetaEvo/RLDE-AFLNot found
RLDE-PFRA Reinforcement Learning-Assisted Differential Evolution with Population Feature ReplayEngineering Applications of Artificial Intelligence 2026Strive-code/rl-pfrNot found
RL-PC-MOEA/DReinforcement Learning Aided Parameter Control in Multi-Objective Evolutionary Algorithm Based on DecompositionProgress in Artificial Intelligence 2018Not foundNot found
RL-AMHReinforcement Learning Based Adaptive MetaheuristicsGECCO 2022 CompanionNot foundNot found
RL-OGPAReinforcement Learning for Enhanced Online Gradient-Based Parameter Adaptation in MetaheuristicsSwarm and Evolutionary Computation 2023Not foundNot found
DRL-DASDeep Reinforcement Learning for Dynamic Algorithm Selection: A Proof-of-Principle Study on Differential EvolutionIEEE TSMC: Systems 2024Not foundNot found
DRL-PC-MOECParameter Control Framework for Multiobjective Evolutionary Computation Based on Deep Reinforcement LearningInternational Journal of Intelligent Systems 2024Not foundNot found
KB-HPA-DEKnowledge-Based Hyper-Parameter Adaptation of Multi-Stage Differential Evolution by Deep Reinforcement LearningNeurocomputing 2025Not foundNot found
RLCDE-LBFGSReinforcement Learning-Controlled Differential Evolution with L-BFGS RefinementsPLOS ONE 2026Not foundNot found

Dynamic Resource Allocation

Other RL-assisted EA methods

Browse all 11 canonical works

Synergistic Optimization of EA and RL

EA and RL both contribute directly to solving the task, either in a shared solution space or through decomposed subproblems.

Single-Agent Optimization

Browse all 35 canonical works
MethodPaperVenueCodeGuide
ERLEvolution-Guided Policy Gradient in Reinforcement LearningNeurIPS 2018ShawK91/Evolutionary-Reinforcement-LearningEN 1 · Extended
EN 2 · Extended
CERLCollaborative Evolutionary Reinforcement LearningICML 2019intel/cerlEN · Core
PDERLProximal Distilled Evolutionary Reinforcement LearningAAAI 2020crisbodnar/pderl中文 · Extended
SCA Surrogate-Assisted Controller for Expensive Evolutionary Reinforcement LearningInformation Sciences 2022Yuxing-Wang-THU/Surrogate-assisted-ERL中文 · Extended
EN · Extended
GEATLEvolutionary Reinforcement Learning for Sparse RewardsGECCO 2021Not foundNot found
CSPSCooperative Heterogeneous Deep Reinforcement LearningNeurIPS 2020Not foundNot found
T-ERLRethinking Population-Assisted Off-Policy Reinforcement LearningGECCO 2023Not foundNot found
ESACOff-Policy Evolutionary Reinforcement Learning with Maximum MutationsAAMAS 2022karush17/esacNot found
PGPSCoupling Policy Gradient with Population-Based SearchICLR 2021 submissionNot foundNot found
VEB-RLValue-Evolutionary-Based Reinforcement LearningICML 2024yeshenpy/VEB-RL中文 · Core
EN · Extended
EvoRainbow / EvoRainbow-ExpEvoRainbow: Combining Improvements in Evolutionary Reinforcement Learning for Policy SearchICML 2024yeshenpy/EvoRainbow中文 · Core
EN · Extended
ERL-TDERL-TD: Evolutionary Reinforcement Learning Enhanced with Truncated Variance and Distillation MutationAAAI 20242019cyf/ERL-TDNot found
CORECORE: Collaborative Optimization with Reinforcement Learning and Evolutionary Algorithm for FloorplanningNeurIPS 2025yeshenpy/CORE中文 · Core
EN · Extended
RIMRecruitment-imitation mechanism for evolutionary reinforcement learningInformation Sciences 2021Not foundNot found
PESProximal evolutionary strategy: improving deep reinforcement learning through evolutionary policy optimizationMemetic Computing 2024Not foundNot found
RPSA-RLEvolutionary Reinforcement Learning by Rank-one Evolution Strategy with Population Size ControlCIS 2023Not foundNot found
EIERLAn Efficient Task-Oriented Dialogue Policy: Evolutionary Reinforcement Learning Injected by Elite IndividualsACL 2025Not foundNot found
Evo-RL for DPDPA collaborative evolutionary reinforcement learning approach to dynamic pickup and delivery challengesTransportation Research Part E: Logistics and Transportation Review 2026Not foundNot found
NES-ERLNeuroevolution Strategies for Episodic Reinforcement LearningJournal of Algorithms 2009Not foundNot found
Preference RacingPreference-Based Reinforcement Learning: Evolutionary Direct Policy Search Using a Preference-Based Racing AlgorithmMachine Learning 2014Not foundNot found
TRESTrust Region Evolution StrategiesAAAI 2019Not foundNot found
AMF-ERLAdaptive Multifactorial Evolutionary Optimization for Multitask Reinforcement LearningIEEE TEVC 2022Not foundNot found
SOSExploring Safer Behaviors for Deep Reinforcement LearningAAAI 2022Not foundNot found
MO-PDERLA Two-Stage Multi-Objective Evolutionary Reinforcement Learning Framework for Continuous Robot ControlGECCO 2023Tran-Long/mopderlNot found
Safety-Informed ERLEvolutionary Reinforcement Learning: Hybrid Approach for Safety-Informed Fault-Tolerant Flight ControlJournal of Guidance, Control, and Dynamics 2024Not foundNot found
ERLBioSeqDesigning Biological Sequences without Prior Knowledge Using Evolutionary Reinforcement LearningAAAI 2024Not foundNot found
EvODScale Optimization Using Evolutionary Reinforcement Learning for Object Detection on Drone ImageryAAAI 2024UNNC-CV/EvODNot found
MO-ERLExtending Evolution-Guided Policy Gradient Learning into the Multi-Objective DomainNeurocomputing 2025Not foundNot found
MCE-ERLMCE-ERL: Evolutionary Reinforcement Learning Algorithm with Multi-Distribution Critics EvaluationICNSC 2025Not foundNot found
Hetero-ERLHeterogeneous Evolutionary Reinforcement Learning with Mixed Attention and Diffusion Model for Dynamic Seru FormationSwarm and Evolutionary Computation 2026Not foundNot found
EARL-NCOEvolutionary Augmented Reinforcement Learning for Neural Combinatorial OptimizationIEEE TEVC 2026Not foundNot found
PD-EPOPreference-Driven Evolutionary Policy Optimization in Multi-Objective Reinforcement LearningIEEE Access 2026Not foundNot found
LLM-EA-HFSPA Large Language Model-Assisted Reinforcement Learning Framework with Evolutionary Algorithm for Hybrid Flow-Shop SchedulingIEEE TEVC 2026Not foundNot found
ERL-WPSSAn Evolutionary Reinforcement Learning Framework for Joint Work Package Sizing and Scheduling with UncertaintiesEuropean Journal of Operational Research 2026Not foundNot found
ERL-ER-FedHGERL-ER-FedHG: Evolutionary Reinforcement Learning with Experience Replay for Federated Heterogeneous GraphsApplied Soft Computing 2026Not foundNot found

EvoRainbow and its experimental label refer to one paper and count once. CORE remains primarily single-agent ERL; solution-space/policy-space co-optimization is retained as a secondary tag, and its recent-work row is a non-counting cross-list.

Adaptive, Staged, or Stabilized Coupling

MethodPaperVenueCodeGuide
BELEfficient and Stable Off-policy Training via Behavior-aware Evolutionary LearningCoRL 2022 / PMLR 2023raymond-myc/BELNot found
AERL / AESACAdaptive Evolutionary Reinforcement Learning with Policy DirectionNeural Processing Letters 2024Not foundNot found
TERLTwo-Stage Evolutionary Reinforcement Learning for Enhancing Exploration and ExploitationAAAI 2024Not foundNot found
NCG-ERLBalance of exploration and exploitation: Non-cooperative game-driven evolutionary reinforcement learningSwarm and Evolutionary Computation 2024Not foundNot found
GDRGenetic Drift Regularization: On Preventing Actor Injection from Breaking Evolution StrategiesIEEE CEC 2024Not foundNot found
AERL-ETAdaptive Evolutionary Reinforcement Learning Algorithm with Early Termination StrategyAAMAS 2024Not foundNot found
SERL-OS-EFStrategic Evolutionary Reinforcement Learning With Operator Selection and Experience FilterIEEE TNNLS 2025Not foundNot found
GECE-RLGenetic-Enhanced Cross-Entropy Reinforcement LearningNeurocomputing 2026Sofilyzia/gece-rlNot found
Progressive Episodes ESAn Evolution Strategy with Progressive Episode Lengths for Playing GamesIJCAI 2019Not foundNot found
AES-EMAdaptive Evolution Strategy with Ensemble of Mutations for Reinforcement LearningKnowledge-Based Systems 2022Not foundNot found
MTNE-LSEMultitask Neuroevolution for Reinforcement Learning With Long and Short EpisodesIEEE TCDS 2023Not foundNot found
GESPGeneralized Early Stopping in Evolutionary Direct Policy SearchACM TELO 2024Not foundNot found
Adaptive Mutation ERLAdaptive Optimization in Evolutionary Reinforcement Learning Using Evolutionary Mutation RatesIEEE Access 2024Not foundNot found
ACERL-DMHRobust Dynamic Material Handling via Adaptive Constrained Evolutionary Reinforcement LearningIEEE TNNLS 2025Not foundNot found
DG-ERLDynamic Grouping Evolutionary Reinforcement Learning Algorithm for Scheduling Workflows in Hybrid CloudsApplied Soft Computing 2026Not foundNot found
LCERLEvolutionary Reinforcement Learning With Late-Start Evolution and Clustering ArchiveIEEE TEVC 2026Not foundNot found
Dual-Drive-ERLDual-Drive-ERL: A Dual-Population Interactive-Driven Evolutionary Reinforcement Learning Algorithm for Dynamic Traffic AssignmentIEEE CEC 2026Not foundNot found

Representation and Search Decomposition

MethodPaperVenueCodeGuide
ERL-Re2ERL-Re^2: Efficient Evolutionary Reinforcement Learning with Shared State Representation and Individual Policy RepresentationICLR 2023yeshenpy/ERL-Re2中文 · Core
EN · Extended
CoERLEvolutionary Reinforcement Learning via Cooperative CoevolutionECAI 2024HcPlu/CoERLNot found
ERL-CDRERL-CDR: Evolutionary Reinforcement Learning with Causal Decoupling RepresentationICA3PP 2025 · first online 2026Not foundNot found
SAR-ERLSAR-ERL: an evolutionary reinforcement learning optimization method based on state-action co-representation embeddingComplex & Intelligent Systems 2026Not foundNot found
MO-CoERLMO-CoERL: Multi-objective cooperative evolutionary deep reinforcement learningInformation Sciences 2026Not foundNot found
ER-MRLEvolving Reservoirs for Meta Reinforcement LearningEvoApplications 2024corentinlger/ER-MRLNot found
EFAEvolutionary Function Approximation for Reinforcement LearningJMLR 2006Not foundNot found
SE-EFASample-Efficient Evolutionary Function Approximation for Reinforcement LearningAAAI 2006Not foundNot found
GP Feature DiscoveryFeature Discovery in Reinforcement Learning Using Genetic ProgrammingEuroGP 2008Not foundNot found
CoSyNEAccelerated Neural Evolution through Cooperatively Coevolved SynapsesJMLR 2008Not foundNot found
World ModelsRecurrent World Models Facilitate Policy EvolutionNeurIPS 2018hardmaru/WorldModelsExperimentsNot found
Weight-Freezing ERLEvolutionary Reinforcement Learning with Weight-Freezing and Markov Blanket-Based Dimensionality ReductionSwarm and Evolutionary Computation 2026oladayosolomon/xSTMBGANot found
Co-PDERLCo-Evolutionary Proximal Distilled Evolutionary Reinforcement Learning with Gated Knowledge TransferMathematics 2026Not foundNot found
EE-MORLExperience Evolution-Guided Multi-Objective Reinforcement LearningIEEE TEVC 2026Not foundNot found

Multi-Agent Optimization

MethodPaperVenueCodeGuide
MERLEvolutionary Reinforcement Learning for Sample-Efficient Multiagent CoordinationICML 2020ShawK91/MERL中文 · Core
EN · Core
NS-MERLNovelty Seeking Multi-Agent ERLGECCO 2023Not foundNot found
CEMARLEvolution Strategies Enhanced Complex Multiagent CoordinationIJCNN 2023Not foundNot found
EMARLCooperation and Competition: Flocking with Evolutionary Multi-Agent Reinforcement LearningICONIP 2022Not foundNot found
RACERACE: Improve Multi-Agent Reinforcement Learning with Representation Asymmetry and Collaborative EvolutionICML 2023yeshenpy/RACE中文 · Core
EN · Extended
MRPMA modified evolutionary reinforcement learning for multi-agent region protection with fewer defendersComplex & Intelligent Systems 2024Not foundNot found
EMARL-UAVAn Evolutionary Multi-Agent Reinforcement Learning Algorithm for Multi-UAV Air CombatKnowledge-Based Systems 2024Not foundNot found
MAERL-CGMulti-Agent Evolutionary Reinforcement Learning Based on Cooperative GamesIEEE TETCI 2025 · early access 2024Not foundNot found
EECGEnhancing Graph-Based Coordination with Evolutionary Algorithms for Episodic Multi-Agent Reinforcement LearningAAMAS 2025MercyM/EECGNot found
CCLCCL: Collaborative Curriculum Learning for Sparse-Reward Multi-Agent Reinforcement Learning via Co-Evolutionary Task EvolutionICIC 2025Not foundNot found
GDEGraph Based Multi-Agent Reinforcement Learning with Evolutionary Population for CooperationNeural Networks 2026MercyM/GDENot found
ES-MCV DispatchMultiagent Deep Reinforcement Learning With Evolutionary Strategy for Mobile Charging Vehicles DispatchingIEEE TNNLS 2026Not foundNot found

Reward Design

Reward search is split by mechanism so classical evolutionary reward search is not conflated with LLM-generated reward programs. Evo-Reward is counted here; EA-assisted reward search is a secondary tag only.

Browse all 12 canonical works
MethodPaperVenueCodeGuide
Evo-RewardGenetic Programming for Reward Function SearchIEEE TAMD 2010Not foundNot found
Co-Evolved Shaping RewardsCo-Evolution of Shaping Rewards and Meta-Parameters in Reinforcement LearningAdaptive Behavior 2008Not foundNot found
Evolutionary Intrinsic MotivationIntrinsically Motivated Reinforcement Learning: An Evolutionary PerspectiveIEEE TAMD 2010Not foundNot found
GP End-Goal RewardBreaking Free from Hand-Crafted Rewards: A Genetic Programming Framework for End-Goal-Driven Reinforcement LearningIEEE CEC 2026Not foundNot found

LLM-based Reward Program Evolution

Morphological Evolution

Interpretable AI

Learning Classifier Systems

MethodPaperVenueCodeGuide
XCSClassifier Fitness Based on AccuracyEvolutionary Computation 1995community implementationEN · Extended
XCSG / XCSRGGradient Descent Methods in Learning Classifier Systems: Improving XCS Performance in Multistep ProblemsIEEE TEVC 2005Not foundNot found
XCSFClassifiers That Approximate FunctionsNatural Computing 2002Not foundNot found
XCSF with tile codingXCSF with Tile Coding in Discontinuous Action-Value LandscapesEvolutionary Intelligence 2015Not foundNot found
DGP-XCSFDynamical Genetic Programming in XCSFEvolutionary Computation 2013Not foundNot found

Frameworks, benchmarks, and tooling

ResourceScopePaperCodeGuide
EvoRLGPU-accelerated ERL, EC, AutoRL, and RL workflows in JAXEvoRL: A GPU-Accelerated Framework for ERL, ACM TELO 2025EMI-Group/evorlNot found
EvoXDistributed GPU-accelerated evolutionary computationDocumentationEMI-Group/evoxNot found
QDaxQuality-Diversity and neuroevolution in JAXQDaxadaptive-intelligent-robotics/QDaxNot found
QD skill discoveryComparing neuroevolution and RL for skill discoveryPaperinstadeepai/qd-skill-discovery-benchmarkNot found
EvoGymCo-design benchmark for soft robotsPaperEvolutionGym/evogym中文 1 · Core
中文 2 · Core
EN 1 · Core
EN 2 · Extended
PBRL GPU BenchmarkGPU-accelerated population-based RL evaluation across robotic tasksBenchmarking Population-Based Reinforcement Learning across Robotic Tasks with GPU-Accelerated Simulation, IEEE CASE 2025Asad-Shahid/PBRLNot found

These are non-canonical implementation, benchmark, or tooling resources and do not enter the 270-work or code-first counts. EvoGym is cross-listed with Morphological Evolution and counted once there.

Recent and emerging directions

Accepted papers are separated from canonical preprints and the non-counting watchlist. CORE and LaRes are cross-listed here for recency and are counted only in their primary synergistic branches.

Published or accepted

Canonical preprints and active submissions

MethodPaperStatusCodeGuide
Differentiable Evolutionary Reinforcement LearningarXiv:2512.13399Preprintsitaocheng/DERLEN · Extended
Lifelong Control through Neuro-EvolutionOpenReviewSubmitted workNot foundNot found

Watchlist (not counted as canonical works)

MethodPaperStatusCodeGuide
MEGAModel Evolution Framework with Genetic Algorithm for Multi-Task Reinforcement LearningPreprint 2025; no formal venue verifiedNot foundNot found
Surrogate AE-HNN ERLSurrogate-Assisted Evolutionary Reinforcement Learning Based on Autoencoder and Hyperbolic Neural NetworkPreprint 2025; no formal venue verifiedNot foundNot found
BASILBASIL: Best-Action Symbolic Interpretable Learning for Evolving Compact RL PoliciesPreprint 2025; no formal venue verifiedNot foundNot found
E-SPLEvolutionary System Prompt Learning for Reinforcement Learning in LLMsAccepted at ICML 2026 CompLearn WorkshopLunjunZhang/E-SPLNot found
SV-QD-RLStructure-Conditioned Actor-Critic Branches for Quality-Diversity Reinforcement LearningPreprint 2026; no formal venue verifiedNot foundNot found
NEOLProvably Sub-Linear Two-Timescale NeuroEvolution with Online PlasticityAccepted at IJCAI-ECAI 2026boobaa2001/NeuroEvolution_Online_Learning_NEOLNot found
GERSEvolutionary Bilevel Reward Shaping for Generalization in Reinforcement LearningPreprint; author reports PPSN 2026 acceptanceNot foundNot found
Developmental Reward SchedulesEvolutionary Discovery of Developmental Reward Schedules in Deep Reinforcement LearningPreprint; author reports IEEE ICDL 2026 acceptancealannadels/Evolutionary_RLNot found
HTSE candidateScalable Evolutionary Hierarchical Reinforcement LearningGECCO 2022 Companion candidate; HTSE identity not uniquely confirmedNot foundNot found
Diverse RL Agents with MAP-ElitesEvolving Populations of Diverse RL Agents with MAP-ElitesPreprint 2023; no formal venue verifiedNot foundNot found
Evolving Constrained RL PolicyEvolving Constrained Reinforcement Learning PolicyPreprint 2023; no formal venue verifiedNot foundNot found
RL-GFMGrid-Based Evolutionary Algorithm for Multi-Objective Molecule Generation Enhanced by Reinforcement LearningUnder review at ICLR 2026Not foundNot found
HERLHERL: Hybrid Evolutionary and Reinforcement Learning Method for Macro PlacementIEEE TII Early Access 2026; independent ERL-mechanism verification pendingNot foundNot found
PG-QD Cooperative MARLCombining Policy Gradients with Quality-Diversity in Cooperative Multi-Agent Reinforcement LearningGECCO 2026 Companion short paper; full mechanism or extension pendingNot foundNot found

Contributing

Please open an issue or pull request with:

  1. the paper title and BibTeX;
  2. an official paper URL (publisher, proceedings, arXiv, or OpenReview);
  3. an author-maintained code URL, if available;
  4. one taxonomy branch from this README;
  5. one or two sentences explaining the EA-RL interaction.

To keep the list reliable, unofficial mirrors, generic search pages, and paper pages mislabeled as code will not be added.

Citation

@article{li2025bridging,
  author  = {Pengyi Li and Jianye Hao and Hongyao Tang and Xian Fu and Yan Zheng and Ke Tang},
  title   = {Bridging Evolutionary Algorithms and Reinforcement Learning: A Comprehensive Survey on Hybrid Algorithms},
  journal = {IEEE Transactions on Evolutionary Computation},
  year    = {2025},
  volume  = {29},
  number  = {5},
  pages   = {1707--1728},
  doi     = {10.1109/TEVC.2024.3443913}
}

Contributors

yeshenpy

91 commits

CyanWatts

10 commits

luchris429

1 commits

yeshenpy/Awesome-Evolutionary-Reinforcement-Learning

Research Papers and Code Repository on the Integration of Evolutionary Algorithms and Reinforcement Learning

390

102 commits

updated Aug 29, 2026

See the code

README

[!IMPORTANT] Official companion repository for Bridging Evolutionary Algorithms and Reinforcement Learning: A Comprehensive Survey on Hybrid Algorithms.
This repository helps readers enter the ERL field faster, reproduce representative methods, navigate the survey taxonomy, and track new papers and code. It currently indexes 270 canonical algorithm works and curates 86 independently reviewed Chinese and English guide mappings across 80 unique URLs, covering 54 works.

Official companion repository for the evolutionary reinforcement learning survey

Awesome Evolutionary Reinforcement Learning

The research companion for studying, reproducing, and extending ERL

Awesome Survey IEEE TEVC 86 verified bilingual reading-guide mappings Contributions welcome

Evolutionary Reinforcement Learning (ERL) combines the global search and population diversity of evolutionary algorithms with the learning efficiency and decision-making capabilities of reinforcement learning. Alongside papers and verified code, this collection provides independently reviewed 中文 / English explanations so readers can move quickly from the survey taxonomy to understanding, reproducing, and extending representative methods.

Read the survey · Browse the taxonomy · 中文 / English reading guides · Start from code · See recent work


Overview

3 major directions21 maintained branches270 canonical algorithm works80 with verified public code
EA → RL · RL → EA · SynergySurvey branches plus maintained extensions264 taxonomy works + 6 recent worksCanonical works with an exact code match

Reproducible count policy (30 Aug 2026): one canonical work equals one unique paper record, regardless of aliases, variants, or cross-listings. The 270 total excludes tooling/benchmarks, field overviews, and the independent watchlist. Code coverage counts canonical works with an exact author/official or explicitly labeled community implementation.

[!IMPORTANT] Which survey version should you use? Cite the IEEE version of record, read arXiv v5 for the latest paper content, and use this repository for code and ongoing updates. See the exact differences ↓

Choose a direction

01 · EA assists RL02 · RL assists EA03 · EA and RL collaborate
Evolution searches policies, actions, hyperparameters, curricula, or reward structures for RL.RL configures initialization, evaluation, variation, operator selection, and EA hyperparameters.Population search and gradient learning exchange information or optimize jointly.
Explore EA-assisted RL ↓Explore RL-assisted EA ↓Explore synergistic ERL ↓

Quick paths

Need reproducible baselines? Start from the code-first list and frameworks.
Need an explanation first? Start from the integrated bilingual reading-guide overview, then open the full work-by-work guide when you need a specific method.
Tracking the newest work? Go to recent and emerging directions.

[!NOTE] Code labels: repository links are author-maintained unless explicitly marked as a community implementation. Not found means no verified public implementation was located. Some methods are intentionally cross-listed when one mechanism contributes to multiple branches.

Changelog
  • 30 Aug 2026 — completed a multi-scope coverage adjudication: added 120 canonical works, expanded the collection to 270 papers and 80 verified code artifacts, corrected QD-PG metadata, and retained 14 independently tracked boundary items in a non-counting watchlist.
  • 29 Aug 2026 — refined the bilingual reading guide to 86 verified work-link mappings across 54 works after a stricter mechanism-depth audit removed mismatched and installation-only references.
  • 28 Aug 2026 — synchronized the collection with arXiv v5; added Reward Design, Dynamic Operator Selection, missing QD methods, recent 2024–2026 work, verified code repositories, frameworks, and updated taxonomy figures.
  • 26 Jul 2024 — the survey was accepted by IEEE Transactions on Evolutionary Computation.
Full section index

Bilingual reading guides

The reading guide is integrated into this repository as a second layer over the survey taxonomy: use the compact paths below to enter a direction quickly, then open the complete work-by-work guide for all reviewed resources.

270 works reviewed54 works covered27 with Chinese material45 with English material86 verified mappings
Full collectionAt least one guide中文讲解English guides80 unique URLs

Core marks substantial, work-specific explanations. Extended marks concise but mechanism-bearing overview sections, project documentation, thesis chapters, posters, or talk slides. Installation-only repositories, abstract restatements, and references that merely mention a method are excluded.

Guide coverage and mapping counts are deduplicated by canonical paper/work URL, language, guide URL, and Core/Extended label; aliases and cross-lists do not add mappings.

Research directionCoverageSuggested starting points
EA assists RL13 / 47 worksPBT · English · Go-Explore · 中文 · Qt-Opt · English
RL assists EA15 / 105 worksDeepACO · 中文 · LOOP · English · TD-MPC · 中文
EA and RL collaborate23 / 112 worksRACE · 中文 · Eureka · English · ROSKA · 中文
Recent directions3 / 6 worksFollow verified projects and author material in the full guide.

Browse the complete bilingual guide →

Taxonomy

Survey v5 organizes ERL into three major directions and sixteen research branches. The maintained repository uses twenty-one branches after adding five evidence-backed extensions: algorithm/update-rule discovery, quality-diversity, dynamic resource allocation, adaptive/staged/stabilized coupling, and representation/search decomposition.

ERL taxonomy

Figure 1. Taxonomy of evolutionary reinforcement learning in survey v5.

[!NOTE] Survey v5 Table V and the body text additionally include LERO under Reward Design and discuss XCSRG alongside XCSG. The detailed tables below follow the more complete body and tabular taxonomy.

Four integration approaches

Figure 2. Four integration patterns connecting EA and RL across solution and decomposed problem spaces.

Survey versions

VersionStatus and recommended use
Official published versionIEEE TEVC, Vol. 29, No. 5, pp. 1707–1728, 2025 · DOI
The peer-reviewed version of record. Use it for formal citation.
Current paper versionarXiv v5, revised 24 May 2026 · PDF
The author-updated manuscript with expanded method coverage. Use it for the latest survey content.
Current repository versionSynced 30 Aug 2026 with v5, multi-scope coverage adjudication, verified code links, frameworks, and a separately counted watchlist. Use it for implementation and tracking.

Difference at a glance: IEEE = archival citation · arXiv v5 = latest paper content · GitHub = maintained implementation index

The repository includes code availability, tooling, and newer work that should not be treated as part of the archival IEEE article.

Paper: Bridging Evolutionary Algorithms and Reinforcement Learning: A Comprehensive Survey on Hybrid Algorithms — Pengyi Li, Jianye Hao, Hongyao Tang, Xian Fu, Yan Zheng, and Ke Tang.

Code-first reading list

The following papers have public implementations verified against the paper, project page, or authors' repositories and are useful starting points. Community reimplementations are kept out of this short list and labeled explicitly in the full taxonomy.

Verified code-first collection (31 entries)
DirectionMethodPaperCodeGuide
EA-assisted RLSAC-CEPOSoft Actor-Critic with Cross-Entropy Policy Optimizationwcgcyx/SAC-CEPONot found
EA-assisted RLGRACGRAC: Self-Guided and Self-Regularized Actor-Criticstanford-iprl-lab/GRACEN · Extended
EA-assisted RLOMARPlan Better Amid Conservatism: Offline Multi-Agent Reinforcement Learning with Actor Rectificationling-pan/OMARNot found
EA-assisted RLSEARLSample-Efficient Automated Deep Reinforcement Learningautoml/SEARLEN · Extended
EA-assisted RLEvolving RL AlgorithmsEvolving Reinforcement Learning Algorithmsgoogle/brain_autorlEN 1 · Core
EN 2 · Core
EA-assisted RLGo-ExploreGo-Explore: a New Approach for Hard-Exploration Problemsuber-research/go-explore中文 1 · Core
中文 2 · Core
EN 1 · Core
EN 2 · Extended
EA-assisted RLROMANCERobust Multi-Agent Coordination via Evolutionary Generation of Auxiliary Adversarial Attackerszzq-bot/ROMANCENot found
EA-assisted RLEvILEvolution Strategies for Generalisable Imitation LearningSilviaSapora/evilEN · Extended
RL-assisted EADeepACODeepACO: Neural-Enhanced Ant Systems for Combinatorial Optimizationhenry-yeh/DeepACO中文 1 · Core
中文 2 · Core
EN · Extended
RL-assisted EACEM-RLCombining Evolutionary and Gradient-Based Methods for Policy Searchapourchot/CEM-RL中文 · Extended
EN · Extended
RL-assisted EAPGA-MEPolicy Gradient Assisted MAP-Elitesollebompa/PGA-MAP-ElitesEN · Extended
RL-assisted EACMA-MEGAApproximating Gradients for Differentiable Quality Diversity in Reinforcement Learningicaros-usc/dqd-rlEN 1 · Extended
EN 2 · Extended
RL-assisted EACCQDSample-Efficient Quality-Diversity by Cooperative Coevolutionlamda-bbo/CCQDNot found
RL-assisted EARefQDQuality-Diversity with Limited Resourceslamda-bbo/RefQDEN · Extended
RL-assisted EAWujiAutomatic Online Combat Game Testing Using Evolutionary Deep Reinforcement LearningNeteaseFuxiRL/wuji中文 · Core
SynergisticERLEvolution-Guided Policy Gradient in Reinforcement LearningShawK91/Evolutionary-Reinforcement-LearningEN 1 · Extended
EN 2 · Extended
SynergisticCERLCollaborative Evolutionary Reinforcement Learningintel/cerlEN · Core
SynergisticPDERLProximal Distilled Evolutionary Reinforcement Learningcrisbodnar/pderl中文 · Extended
SynergisticERL-Re2ERL-Re^2: Efficient Evolutionary Reinforcement Learning with Shared State Representation and Individual Policy Representationyeshenpy/ERL-Re2中文 · Core
EN · Extended
SynergisticVEB-RLValue-Evolutionary-Based Reinforcement Learningyeshenpy/VEB-RL中文 · Core
EN · Extended
SynergisticEvoRainbowEvoRainbow: Combining Improvements in Evolutionary Reinforcement Learning for Policy Searchyeshenpy/EvoRainbow中文 · Core
EN · Extended
SynergisticRACERACE: Improve Multi-Agent Reinforcement Learning with Representation Asymmetry and Collaborative Evolutionyeshenpy/RACE中文 · Core
EN · Extended
SynergisticCORECORE: Collaborative Optimization with Reinforcement Learning and Evolutionary Algorithm for Floorplanningyeshenpy/CORE中文 · Core
EN · Extended
Reward designEurekaHuman-Level Reward Design via Coding Large Language Modelseureka-research/Eureka中文 1 · Core
中文 2 · Core
EN 1 · Core
EN 2 · Extended
Reward designDrEurekaLanguage Model Guided Sim-to-Real Transfereureka-research/dreurekaEN · Extended
Reward designLaResLaRes: Evolutionary Reinforcement Learning with LLM-Based Adaptive Reward Searchyeshenpy/LaRes中文 · Core
EN · Extended
MorphologyEvoGymEvolution Gym: A Large-Scale Benchmark for Evolving Soft RobotsEvolutionGym/evogym中文 1 · Core
中文 2 · Core
EN 1 · Core
EN 2 · Extended
MorphologyHERDLeveraging Hyperbolic Embeddings for Coarse-to-Fine Robot Designdrdh/HERDEN · Extended
MorphologyAIEARapidly Evolving Soft Robots via Action InheritanceHandingWangXDGroup/AIEANot found
MorphologyDERLEmbodied Intelligence via Learning and Evolutionagrimgupta92/derl中文 · Core
EN 1 · Core
EN 2 · Extended
MorphologyTAMETask-Agnostic Morphology Evolutionjhejna/morphology-optNot found

EA-assisted Optimization of RL

EA → RL · Evolutionary search supports reinforcement learning while RL remains responsible for solving the task.

↑ Overview · Next: RL-assisted EA →

EA-assisted Action Selection

Browse all 11 methods

Hyperparameter Optimization

Algorithm and Update-rule Discovery

Other EA-assisted RL methods

Browse all 18 methods
MethodPaperVenueCodeGuide
GP-MAXQEvolutionary Development of Hierarchical Learning StructuresIEEE TEVC 2007Not foundEN · Extended
PNS-RLPNS: Population-Guided Novelty Search for Reinforcement Learning in Hard Exploration EnvironmentsIROS 2021Not foundNot found
Go-ExploreGo-Explore: a New Approach for Hard-Exploration ProblemsarXiv 2019, rev. 2021uber-research/go-explore中文 1 · Core
中文 2 · Core
EN 1 · Core
EN 2 · Extended
G2NGenetic-Gated Networks for Deep Reinforcement LearningNeurIPS 2018Not foundNot found
EVO-RLEvolutionary-Driven Reinforcement LearningGECCO 2021Not foundNot found
ROMANCERobust Multi-Agent Coordination via Evolutionary Generation of Auxiliary Adversarial AttackersAAAI 2023zzq-bot/ROMANCENot found
MA3CCommunication-robust multi-agent learning by adaptable auxiliary multi-agent adversary generationFrontiers of Computer Science 2024Not found中文 · Extended
EPCEvolutionary Population Curriculum for Scaling Multi-Agent RLICLR 2020qian18long/epciclr2020EN · Extended
MAPPERMAPPER: Multi-Agent Path Planning with Evolutionary Reinforcement Learning in Mixed Dynamic EnvironmentsIROS 2020Not found中文 · Extended
EvILEvolution Strategies for Generalisable Imitation LearningICML 2024SilviaSapora/evilEN · Extended
Behaviour Distillation (HaDES)Behaviour DistillationICLR 2024FLAIROx/behaviour-distillationNot found
Adversarial Cheap Talk (ACT)Adversarial Cheap TalkICML 2023luchris429/adversarial-cheap-talkNot found
GP Offline DataUsing genetic programming to improve data collection for offline reinforcement learningSwarm and Evolutionary Computation 2025Not foundNot found
EDT Curriculum GoalsHindsight Experience Replay with Evolutionary Decision Trees for Curriculum Goal GenerationEvoApplications 2024Not foundNot found
GA Offline Dataset ReductionDataset Reduction for Offline Reinforcement Learning using Genetic Algorithms with Image-Based HeuristicsGECCO 2025Not foundNot found
AEIRLAdaptive Evolutionary Inverse Reinforcement Learning for Large-Scale Interconnected SystemsNeurocomputing 2026Not foundNot found
ES-KD-MARLEvolutionary Sampling for Knowledge Distillation in Multi-Agent Reinforcement LearningMathematics 2025Not foundNot found
E2CLEfficient Evolutionary Curriculum Learning for Scalable Multi-Agent Reinforcement LearningJournal of King Saud University: Computer and Information Sciences 2025Not foundNot found

RL-assisted Optimization of EA

RL → EA · Reinforcement learning configures or improves one or more stages of an evolutionary algorithm.

← EA-assisted RL · ↑ Overview · Next: Synergistic ERL →

Population Initialization

Population Evaluation

This branch contains seven primary RL-assisted evaluation works plus three secondary mechanism cross-lists. SC, PGPS, and ERL-Re2 remain counted only under their synergistic canonical branches.

MethodPaperVenue / primary listingCodeGuide
SCA Surrogate-Assisted Controller for Expensive Evolutionary Reinforcement LearningSingle-Agent OptimizationYuxing-Wang-THU/Surrogate-assisted-ERL中文 · Extended
EN · Extended
PGPSCoupling Policy Gradient with Population-Based SearchSingle-Agent OptimizationNot foundNot found
ERL-Re2ERL-Re^2: Efficient Evolutionary Reinforcement Learning with Shared State Representation and Individual Policy RepresentationRepresentation and Search Decompositionyeshenpy/ERL-Re2中文 · Core
EN · Extended
Policy Embedding Surrogate ERLEnabling Surrogate-Assisted Evolutionary Reinforcement Learning via Policy EmbeddingBIC-TA 2022Not foundNot found
Neuroevolution SurrogatesSurrogate Models for Enhancing the Efficiency of Neuroevolution in Reinforcement LearningGECCO 2019Not foundNot found
Policy RacingHoeffding and Bernstein Races for Selecting Policies in Evolutionary Direct Policy SearchICML 2009Not foundNot found
Efficient ERL EvaluationAn Efficient Evaluation Mechanism for Evolutionary Reinforcement LearningLNCS 2022Not foundNot found
Hybrid SA-EMORLHybrid Surrogate Assisted Evolutionary Multiobjective Reinforcement Learning for Continuous Robot ControlEvoApplications 2024Not foundNot found
SA-EMARLSurrogate-Assisted Evolutionary Multi-Agent Reinforcement Learning with Adaptive Fitness EvaluationGECCO 2026Not foundNot found
DRL-SMMDeep Reinforcement Learning Assisted Surrogate Model Management for Expensive Constrained Multi-Objective OptimizationSwarm and Evolutionary Computation 2025Not foundNot found

Variation Operator

Browse all 8 canonical works

Quality-Diversity

Browse all 15 canonical works
MethodPaperVenueCodeGuide
NS-RLEfficient Novelty Search through Deep Reinforcement Learningshilx001/NoveltySearch_Improvement中文 · Extended
QD-PGDiversity Policy Gradient for Sample Efficient Quality-Diversity OptimizationGECCO 2022Not found中文 · Extended
PGA-MEPolicy Gradient Assisted MAP-ElitesGECCO 2021ollebompa/PGA-MAP-ElitesEN · Extended
GAC QD-RLUnderstanding the Synergies between Quality-Diversity and Deep Reinforcement LearningPreprint 2023Not foundNot found
CMA-MEGAApproximating Gradients for Differentiable Quality Diversity in Reinforcement LearningGECCO 2022icaros-usc/dqd-rlEN 1 · Extended
EN 2 · Extended
CCQDSample-Efficient Quality-Diversity by Cooperative CoevolutionICLR 2024lamda-bbo/CCQDNot found
RefQDQuality-Diversity with Limited ResourcesGECCO 2024lamda-bbo/RefQDEN · Extended
QDHUACDistributional Value Estimation Without Target Networks for Robust Quality-DiversityGECCO 2026 Full PaperNot foundNot found
EDOCSEvolutionary Diversity Optimization with Clustering-based Selection for Reinforcement LearningICLR 2022official code pageNot found
DvDEffective Diversity in Population Based Reinforcement LearningNeurIPS 2020jparkerholder/DvD_ESNot found
QD-SimQuality-Similar Diversity via Population Based Reinforcement LearningICLR 2023Not foundNot found
NS-ESImproving Exploration in Evolution Strategies for Deep Reinforcement Learning via a Population of Novelty-Seeking AgentsNeurIPS 2018Not foundNot found
CCNCS-ERLEvolutionary Reinforcement Learning via Cooperative Coevolutionary Negatively Correlated SearchSwarm and Evolutionary Computation 2022Not foundNot found
DBBD-ERLEvolutionary reinforcement learning with density-based behavioral diversity enhancement for berth allocation and crane assignmentSwarm and Evolutionary Computation 2026Not foundNot found
QDRL-BRPGQuality-Diversity Reinforcement Learning using Behavior Regulated Policy GradientACM TELO 2026Not foundNot found

Dynamic Operator Selection

This branch was empty in the previous README. Survey v5 identifies sixteen methods.

Browse all 30 methods
MethodPaperVenueCodeGuide
RL-GA(a)Controlling Genetic Algorithms with Reinforcement LearningGECCO 2002Not foundNot found
RLEPAdaptive Evolutionary Programming Based on Reinforcement LearningInformation Sciences 2008Not foundNot found
EA+RLIncreasing Efficiency of Evolutionary Algorithms by Choosing between Auxiliary Fitness Functions with Reinforcement LearningICMLA 2012Not foundNot found
EA+RL(O)Selecting Evolutionary Operators Using Reinforcement Learning: Initial ExplorationsGECCO 2014Not foundNot found
RL-GA(b)RL-GA: A Reinforcement Learning-Based Genetic Algorithm for Electromagnetic Detection Satellite Scheduling ProblemSwarm and Evolutionary Computation 2023Not foundNot found
GSFAutomated Design of Metaheuristics Using Reinforcement Learning within a Novel General Search FrameworkIEEE TEVC 2023Not foundNot found
MARLwCMAEvolutionary Framework with Reinforcement Learning-Based Mutation AdaptationIEEE Access 2020Not foundNot found
MPSORLMulti-strategy self-learning particle swarm optimization algorithm based on reinforcement learningMathematical Biosciences and Engineering 2023Not foundNot found
DEDQNDifferential Evolution with Mixed Mutation Strategy Based on Deep Reinforcement LearningApplied Soft Computing 2021Not foundNot found
DE-DDQNDeep Reinforcement Learning Based Parameter Control in Differential EvolutionGECCO 2019Not foundNot found
RL-CORCOConstrained Evolutionary Optimization Based on Reinforcement Learning Using the Objective Function and ConstraintsKnowledge-Based Systems 2022Not foundNot found
RL-HDEReinforcement Learning-Based Hybrid Differential Evolution for Global Optimization of Interplanetary Trajectory DesignSwarm and Evolutionary Computation 2023Not foundNot found
DE-RLFRDifferential evolution based on reinforcement learning with fitness ranking for solving multimodal multiobjective problemsSwarm and Evolutionary Computation 2019Not foundNot found
LRMODEA Fitness Landscape Ruggedness Multiobjective Differential Evolution Algorithm with a Reinforcement Learning StrategyApplied Soft Computing 2020Not foundNot found
MOEA/D-DQNDeep Reinforcement Learning Based Adaptive Operator Selection for Evolutionary Multi-Objective OptimizationIEEE TETCI 2023Not foundNot found
AMODE-DRLScheduling of Continuous Annealing with a Multi-Objective Differential Evolution Algorithm Based on Deep Reinforcement LearningIEEE T-ASE 2024Not foundNot found
DRL-AEOSFA Deep Reinforcement Learning-Assisted Evolutionary Operator Selection Framework for Constrained Optimization ProblemsSwarm and Evolutionary Computation 2026Not foundNot found
DRL-EMSDeep Reinforcement Learning Based Environmental and Mating Selection for Evolutionary Multi-objective OptimizationGECCO 2026Not foundNot found
DRL-MM-MOEAA Deep Reinforcement Learning-Guided Multimodal Multi-Objective Evolutionary Algorithm with a Serial-Parallel MechanismExpert Systems with Applications 2026Not foundNot found
RL-HH-OESA Reinforcement Learning Hyper-Heuristic for Opposition-Enhanced Shuffled Multi-Strategy Evolutionary Algorithms with Adaptive Population SizingApplied Intelligence 2026official data and MATLAB codeNot found
AOS-RLAdaptive Operator Selection with Reinforcement LearningInformation Sciences 2021Not foundNot found
OVEAA Reference Vector Based Multiobjective Evolutionary Algorithm with Q-Learning for Operator AdaptationSwarm and Evolutionary Computation 2023Not foundNot found
RLDMDEDynamic Multi-Strategy Integrated Differential Evolution Algorithm Based on Reinforcement Learning for Optimization ProblemsComplex & Intelligent Systems 2024Not foundNot found
RL-AOS RuntimeRuntime Analysis of Adaptive Selection Variation Operators in Evolutionary Algorithm with Reinforcement LearningApplied Intelligence 2025Not foundNot found
GEA-AOSAdaptive Operator Selection in Heuristic Optimization Utilizing Generalized Experience with Reinforcement LearningInternational Journal of Parallel, Emergent and Distributed Systems 2025Not foundNot found
TL-AOSTransfer Learning for Operator Selection: A Reinforcement Learning ApproachAlgorithms 2022Not foundNot found
CEDE-DRLDeep Reinforcement Learning Assisted Co-Evolutionary Differential Evolution for Constrained OptimizationSwarm and Evolutionary Computation 2023Not foundNot found
DRL-AOS-CMOConstrained Multi-Objective Optimization With Deep Reinforcement Learning Assisted Operator SelectionIEEE/CAA Journal of Automatica Sinica 2024Not foundNot found
RL-CMTOA Reinforcement Learning Assisted Evolutionary Algorithm for Constrained Multi-Task OptimizationInformation Sciences 2024Not foundNot found
DRL-AOPDeep Reinforcement Learning-Assisted Automated Operator Portfolio for Constrained Multi-Objective OptimizationIEEE TETCI 2026Not foundNot found

Dynamic Algorithm Configuration

This maintained branch extends the survey's hyperparameter-configuration grouping to cover learned, state-dependent algorithm configuration. Survey v5 contains AGA, LTO, RL-DAC, REM, Q-LSHADE & DQ-HSES, MADAC, qlDE, and RLDE; GS-DAC is the round-2 addition.

Browse all 29 canonical works
MethodPaperVenueCodeGuide
AGAReinforcement Learning for Online Control of Evolutionary AlgorithmsNot foundNot found
LTOLearning Step-Size Adaptation in CMA-ESautoml/LTO-CMAEN · Extended
RL-DACDynamic Algorithm Configuration: Foundation of a New Meta-Algorithmic Frameworkautoml/DACEN · Extended
REMVariational Reinforcement Learning for Hyper-Parameter Tuning of Adaptive Evolutionary AlgorithmNot foundNot found
MADACMultiagent Dynamic Algorithm Configurationlamda-bbo/madacEN · Extended
Q-LSHADE & DQ-HSESControlling Sequential Hybrid EA by Q-Learningofficial codeNot found
qlDEQ-Learning-Based Parameter Control in Differential Evolution for Structural OptimizationNot foundNot found
RLDEReinforcement Learning-Based Differential Evolution for Parameters Extraction of Photovoltaic ModelsNot foundNot found
GS-DACGraph-Supported Dynamic Algorithm Configuration for Multi-Objective Combinatorial OptimizationICML 2025RobbertReijnen/GS-MODACNot found
ERLA-HBSAn Adaptive Evolutionary-Reinforcement Learning Algorithm for Hyperspectral Band SelectionExpert Systems with Applications 2024Not foundNot found
ConfigXConfigX: Modular Configuration for Evolutionary Algorithms via Multitask Reinforcement LearningAAAI 2025MetaEvo/ConfigXNot found
DRL-EA-CMOAutomated Configuration of Evolutionary Algorithms via Deep Reinforcement Learning for Constrained Multiobjective OptimizationIEEE TCYB 2025Not foundNot found
RL-MS-ECMOReinforcement Learning-Assisted Multi-Stage Evolutionary Constrained Multi-Objective OptimizationACM TELO 2025Not foundNot found
AC-RL-MMOIntegrating Actor-Critic Reinforcement Learning With Evolutionary Algorithm for Multimodal Multiobjective OptimizationIEEE TNNLS 2026Not foundNot found
RL-MMOFA Hybrid Evolutionary Framework Assisted by Reinforcement Learning for Mixed Multi-Objective Optimization FeaturesApplied Soft Computing 2026Not foundNot found
RL-EA HelicopterReinforcement Learning-Enhanced Evolutionary Algorithm for Multi-Objective Optimal Control of a Laboratory HelicopterSwarm and Evolutionary Computation 2026Not foundNot found
SuperDEDeep Reinforcement Learning-Assisted Component Auto-Configuration of Differential Evolution Algorithm for Constrained Optimization: A Foundation ModelIEEE TEVC 2026Not foundNot found
MetaMTOLearning Where, What and How to Transfer: A Multi-Role Reinforcement Learning Approach for Evolutionary MultitaskingIEEE TEVC 2026Not foundNot found
LDELearning Adaptive Differential Evolution Algorithm From Optimization Experiences by Policy GradientIEEE TEVC 2021yierh/LDENot found
RL-HPSDEDifferential Evolution with Hybrid Parameters and Mutation Strategies Based on Reinforcement LearningSwarm and Evolutionary Computation 2022Not foundNot found
RLDE-AFLReinforcement Learning-Based Self-Adaptive Differential Evolution Through Automated Landscape Feature LearningGECCO 2025MetaEvo/RLDE-AFLNot found
RLDE-PFRA Reinforcement Learning-Assisted Differential Evolution with Population Feature ReplayEngineering Applications of Artificial Intelligence 2026Strive-code/rl-pfrNot found
RL-PC-MOEA/DReinforcement Learning Aided Parameter Control in Multi-Objective Evolutionary Algorithm Based on DecompositionProgress in Artificial Intelligence 2018Not foundNot found
RL-AMHReinforcement Learning Based Adaptive MetaheuristicsGECCO 2022 CompanionNot foundNot found
RL-OGPAReinforcement Learning for Enhanced Online Gradient-Based Parameter Adaptation in MetaheuristicsSwarm and Evolutionary Computation 2023Not foundNot found
DRL-DASDeep Reinforcement Learning for Dynamic Algorithm Selection: A Proof-of-Principle Study on Differential EvolutionIEEE TSMC: Systems 2024Not foundNot found
DRL-PC-MOECParameter Control Framework for Multiobjective Evolutionary Computation Based on Deep Reinforcement LearningInternational Journal of Intelligent Systems 2024Not foundNot found
KB-HPA-DEKnowledge-Based Hyper-Parameter Adaptation of Multi-Stage Differential Evolution by Deep Reinforcement LearningNeurocomputing 2025Not foundNot found
RLCDE-LBFGSReinforcement Learning-Controlled Differential Evolution with L-BFGS RefinementsPLOS ONE 2026Not foundNot found

Dynamic Resource Allocation

Other RL-assisted EA methods

Browse all 11 canonical works

Synergistic Optimization of EA and RL

EA and RL both contribute directly to solving the task, either in a shared solution space or through decomposed subproblems.

Single-Agent Optimization

Browse all 35 canonical works
MethodPaperVenueCodeGuide
ERLEvolution-Guided Policy Gradient in Reinforcement LearningNeurIPS 2018ShawK91/Evolutionary-Reinforcement-LearningEN 1 · Extended
EN 2 · Extended
CERLCollaborative Evolutionary Reinforcement LearningICML 2019intel/cerlEN · Core
PDERLProximal Distilled Evolutionary Reinforcement LearningAAAI 2020crisbodnar/pderl中文 · Extended
SCA Surrogate-Assisted Controller for Expensive Evolutionary Reinforcement LearningInformation Sciences 2022Yuxing-Wang-THU/Surrogate-assisted-ERL中文 · Extended
EN · Extended
GEATLEvolutionary Reinforcement Learning for Sparse RewardsGECCO 2021Not foundNot found
CSPSCooperative Heterogeneous Deep Reinforcement LearningNeurIPS 2020Not foundNot found
T-ERLRethinking Population-Assisted Off-Policy Reinforcement LearningGECCO 2023Not foundNot found
ESACOff-Policy Evolutionary Reinforcement Learning with Maximum MutationsAAMAS 2022karush17/esacNot found
PGPSCoupling Policy Gradient with Population-Based SearchICLR 2021 submissionNot foundNot found
VEB-RLValue-Evolutionary-Based Reinforcement LearningICML 2024yeshenpy/VEB-RL中文 · Core
EN · Extended
EvoRainbow / EvoRainbow-ExpEvoRainbow: Combining Improvements in Evolutionary Reinforcement Learning for Policy SearchICML 2024yeshenpy/EvoRainbow中文 · Core
EN · Extended
ERL-TDERL-TD: Evolutionary Reinforcement Learning Enhanced with Truncated Variance and Distillation MutationAAAI 20242019cyf/ERL-TDNot found
CORECORE: Collaborative Optimization with Reinforcement Learning and Evolutionary Algorithm for FloorplanningNeurIPS 2025yeshenpy/CORE中文 · Core
EN · Extended
RIMRecruitment-imitation mechanism for evolutionary reinforcement learningInformation Sciences 2021Not foundNot found
PESProximal evolutionary strategy: improving deep reinforcement learning through evolutionary policy optimizationMemetic Computing 2024Not foundNot found
RPSA-RLEvolutionary Reinforcement Learning by Rank-one Evolution Strategy with Population Size ControlCIS 2023Not foundNot found
EIERLAn Efficient Task-Oriented Dialogue Policy: Evolutionary Reinforcement Learning Injected by Elite IndividualsACL 2025Not foundNot found
Evo-RL for DPDPA collaborative evolutionary reinforcement learning approach to dynamic pickup and delivery challengesTransportation Research Part E: Logistics and Transportation Review 2026Not foundNot found
NES-ERLNeuroevolution Strategies for Episodic Reinforcement LearningJournal of Algorithms 2009Not foundNot found
Preference RacingPreference-Based Reinforcement Learning: Evolutionary Direct Policy Search Using a Preference-Based Racing AlgorithmMachine Learning 2014Not foundNot found
TRESTrust Region Evolution StrategiesAAAI 2019Not foundNot found
AMF-ERLAdaptive Multifactorial Evolutionary Optimization for Multitask Reinforcement LearningIEEE TEVC 2022Not foundNot found
SOSExploring Safer Behaviors for Deep Reinforcement LearningAAAI 2022Not foundNot found
MO-PDERLA Two-Stage Multi-Objective Evolutionary Reinforcement Learning Framework for Continuous Robot ControlGECCO 2023Tran-Long/mopderlNot found
Safety-Informed ERLEvolutionary Reinforcement Learning: Hybrid Approach for Safety-Informed Fault-Tolerant Flight ControlJournal of Guidance, Control, and Dynamics 2024Not foundNot found
ERLBioSeqDesigning Biological Sequences without Prior Knowledge Using Evolutionary Reinforcement LearningAAAI 2024Not foundNot found
EvODScale Optimization Using Evolutionary Reinforcement Learning for Object Detection on Drone ImageryAAAI 2024UNNC-CV/EvODNot found
MO-ERLExtending Evolution-Guided Policy Gradient Learning into the Multi-Objective DomainNeurocomputing 2025Not foundNot found
MCE-ERLMCE-ERL: Evolutionary Reinforcement Learning Algorithm with Multi-Distribution Critics EvaluationICNSC 2025Not foundNot found
Hetero-ERLHeterogeneous Evolutionary Reinforcement Learning with Mixed Attention and Diffusion Model for Dynamic Seru FormationSwarm and Evolutionary Computation 2026Not foundNot found
EARL-NCOEvolutionary Augmented Reinforcement Learning for Neural Combinatorial OptimizationIEEE TEVC 2026Not foundNot found
PD-EPOPreference-Driven Evolutionary Policy Optimization in Multi-Objective Reinforcement LearningIEEE Access 2026Not foundNot found
LLM-EA-HFSPA Large Language Model-Assisted Reinforcement Learning Framework with Evolutionary Algorithm for Hybrid Flow-Shop SchedulingIEEE TEVC 2026Not foundNot found
ERL-WPSSAn Evolutionary Reinforcement Learning Framework for Joint Work Package Sizing and Scheduling with UncertaintiesEuropean Journal of Operational Research 2026Not foundNot found
ERL-ER-FedHGERL-ER-FedHG: Evolutionary Reinforcement Learning with Experience Replay for Federated Heterogeneous GraphsApplied Soft Computing 2026Not foundNot found

EvoRainbow and its experimental label refer to one paper and count once. CORE remains primarily single-agent ERL; solution-space/policy-space co-optimization is retained as a secondary tag, and its recent-work row is a non-counting cross-list.

Adaptive, Staged, or Stabilized Coupling

MethodPaperVenueCodeGuide
BELEfficient and Stable Off-policy Training via Behavior-aware Evolutionary LearningCoRL 2022 / PMLR 2023raymond-myc/BELNot found
AERL / AESACAdaptive Evolutionary Reinforcement Learning with Policy DirectionNeural Processing Letters 2024Not foundNot found
TERLTwo-Stage Evolutionary Reinforcement Learning for Enhancing Exploration and ExploitationAAAI 2024Not foundNot found
NCG-ERLBalance of exploration and exploitation: Non-cooperative game-driven evolutionary reinforcement learningSwarm and Evolutionary Computation 2024Not foundNot found
GDRGenetic Drift Regularization: On Preventing Actor Injection from Breaking Evolution StrategiesIEEE CEC 2024Not foundNot found
AERL-ETAdaptive Evolutionary Reinforcement Learning Algorithm with Early Termination StrategyAAMAS 2024Not foundNot found
SERL-OS-EFStrategic Evolutionary Reinforcement Learning With Operator Selection and Experience FilterIEEE TNNLS 2025Not foundNot found
GECE-RLGenetic-Enhanced Cross-Entropy Reinforcement LearningNeurocomputing 2026Sofilyzia/gece-rlNot found
Progressive Episodes ESAn Evolution Strategy with Progressive Episode Lengths for Playing GamesIJCAI 2019Not foundNot found
AES-EMAdaptive Evolution Strategy with Ensemble of Mutations for Reinforcement LearningKnowledge-Based Systems 2022Not foundNot found
MTNE-LSEMultitask Neuroevolution for Reinforcement Learning With Long and Short EpisodesIEEE TCDS 2023Not foundNot found
GESPGeneralized Early Stopping in Evolutionary Direct Policy SearchACM TELO 2024Not foundNot found
Adaptive Mutation ERLAdaptive Optimization in Evolutionary Reinforcement Learning Using Evolutionary Mutation RatesIEEE Access 2024Not foundNot found
ACERL-DMHRobust Dynamic Material Handling via Adaptive Constrained Evolutionary Reinforcement LearningIEEE TNNLS 2025Not foundNot found
DG-ERLDynamic Grouping Evolutionary Reinforcement Learning Algorithm for Scheduling Workflows in Hybrid CloudsApplied Soft Computing 2026Not foundNot found
LCERLEvolutionary Reinforcement Learning With Late-Start Evolution and Clustering ArchiveIEEE TEVC 2026Not foundNot found
Dual-Drive-ERLDual-Drive-ERL: A Dual-Population Interactive-Driven Evolutionary Reinforcement Learning Algorithm for Dynamic Traffic AssignmentIEEE CEC 2026Not foundNot found

Representation and Search Decomposition

MethodPaperVenueCodeGuide
ERL-Re2ERL-Re^2: Efficient Evolutionary Reinforcement Learning with Shared State Representation and Individual Policy RepresentationICLR 2023yeshenpy/ERL-Re2中文 · Core
EN · Extended
CoERLEvolutionary Reinforcement Learning via Cooperative CoevolutionECAI 2024HcPlu/CoERLNot found
ERL-CDRERL-CDR: Evolutionary Reinforcement Learning with Causal Decoupling RepresentationICA3PP 2025 · first online 2026Not foundNot found
SAR-ERLSAR-ERL: an evolutionary reinforcement learning optimization method based on state-action co-representation embeddingComplex & Intelligent Systems 2026Not foundNot found
MO-CoERLMO-CoERL: Multi-objective cooperative evolutionary deep reinforcement learningInformation Sciences 2026Not foundNot found
ER-MRLEvolving Reservoirs for Meta Reinforcement LearningEvoApplications 2024corentinlger/ER-MRLNot found
EFAEvolutionary Function Approximation for Reinforcement LearningJMLR 2006Not foundNot found
SE-EFASample-Efficient Evolutionary Function Approximation for Reinforcement LearningAAAI 2006Not foundNot found
GP Feature DiscoveryFeature Discovery in Reinforcement Learning Using Genetic ProgrammingEuroGP 2008Not foundNot found
CoSyNEAccelerated Neural Evolution through Cooperatively Coevolved SynapsesJMLR 2008Not foundNot found
World ModelsRecurrent World Models Facilitate Policy EvolutionNeurIPS 2018hardmaru/WorldModelsExperimentsNot found
Weight-Freezing ERLEvolutionary Reinforcement Learning with Weight-Freezing and Markov Blanket-Based Dimensionality ReductionSwarm and Evolutionary Computation 2026oladayosolomon/xSTMBGANot found
Co-PDERLCo-Evolutionary Proximal Distilled Evolutionary Reinforcement Learning with Gated Knowledge TransferMathematics 2026Not foundNot found
EE-MORLExperience Evolution-Guided Multi-Objective Reinforcement LearningIEEE TEVC 2026Not foundNot found

Multi-Agent Optimization

MethodPaperVenueCodeGuide
MERLEvolutionary Reinforcement Learning for Sample-Efficient Multiagent CoordinationICML 2020ShawK91/MERL中文 · Core
EN · Core
NS-MERLNovelty Seeking Multi-Agent ERLGECCO 2023Not foundNot found
CEMARLEvolution Strategies Enhanced Complex Multiagent CoordinationIJCNN 2023Not foundNot found
EMARLCooperation and Competition: Flocking with Evolutionary Multi-Agent Reinforcement LearningICONIP 2022Not foundNot found
RACERACE: Improve Multi-Agent Reinforcement Learning with Representation Asymmetry and Collaborative EvolutionICML 2023yeshenpy/RACE中文 · Core
EN · Extended
MRPMA modified evolutionary reinforcement learning for multi-agent region protection with fewer defendersComplex & Intelligent Systems 2024Not foundNot found
EMARL-UAVAn Evolutionary Multi-Agent Reinforcement Learning Algorithm for Multi-UAV Air CombatKnowledge-Based Systems 2024Not foundNot found
MAERL-CGMulti-Agent Evolutionary Reinforcement Learning Based on Cooperative GamesIEEE TETCI 2025 · early access 2024Not foundNot found
EECGEnhancing Graph-Based Coordination with Evolutionary Algorithms for Episodic Multi-Agent Reinforcement LearningAAMAS 2025MercyM/EECGNot found
CCLCCL: Collaborative Curriculum Learning for Sparse-Reward Multi-Agent Reinforcement Learning via Co-Evolutionary Task EvolutionICIC 2025Not foundNot found
GDEGraph Based Multi-Agent Reinforcement Learning with Evolutionary Population for CooperationNeural Networks 2026MercyM/GDENot found
ES-MCV DispatchMultiagent Deep Reinforcement Learning With Evolutionary Strategy for Mobile Charging Vehicles DispatchingIEEE TNNLS 2026Not foundNot found

Reward Design

Reward search is split by mechanism so classical evolutionary reward search is not conflated with LLM-generated reward programs. Evo-Reward is counted here; EA-assisted reward search is a secondary tag only.

Browse all 12 canonical works
MethodPaperVenueCodeGuide
Evo-RewardGenetic Programming for Reward Function SearchIEEE TAMD 2010Not foundNot found
Co-Evolved Shaping RewardsCo-Evolution of Shaping Rewards and Meta-Parameters in Reinforcement LearningAdaptive Behavior 2008Not foundNot found
Evolutionary Intrinsic MotivationIntrinsically Motivated Reinforcement Learning: An Evolutionary PerspectiveIEEE TAMD 2010Not foundNot found
GP End-Goal RewardBreaking Free from Hand-Crafted Rewards: A Genetic Programming Framework for End-Goal-Driven Reinforcement LearningIEEE CEC 2026Not foundNot found

LLM-based Reward Program Evolution

Morphological Evolution

Interpretable AI

Learning Classifier Systems

MethodPaperVenueCodeGuide
XCSClassifier Fitness Based on AccuracyEvolutionary Computation 1995community implementationEN · Extended
XCSG / XCSRGGradient Descent Methods in Learning Classifier Systems: Improving XCS Performance in Multistep ProblemsIEEE TEVC 2005Not foundNot found
XCSFClassifiers That Approximate FunctionsNatural Computing 2002Not foundNot found
XCSF with tile codingXCSF with Tile Coding in Discontinuous Action-Value LandscapesEvolutionary Intelligence 2015Not foundNot found
DGP-XCSFDynamical Genetic Programming in XCSFEvolutionary Computation 2013Not foundNot found

Frameworks, benchmarks, and tooling

ResourceScopePaperCodeGuide
EvoRLGPU-accelerated ERL, EC, AutoRL, and RL workflows in JAXEvoRL: A GPU-Accelerated Framework for ERL, ACM TELO 2025EMI-Group/evorlNot found
EvoXDistributed GPU-accelerated evolutionary computationDocumentationEMI-Group/evoxNot found
QDaxQuality-Diversity and neuroevolution in JAXQDaxadaptive-intelligent-robotics/QDaxNot found
QD skill discoveryComparing neuroevolution and RL for skill discoveryPaperinstadeepai/qd-skill-discovery-benchmarkNot found
EvoGymCo-design benchmark for soft robotsPaperEvolutionGym/evogym中文 1 · Core
中文 2 · Core
EN 1 · Core
EN 2 · Extended
PBRL GPU BenchmarkGPU-accelerated population-based RL evaluation across robotic tasksBenchmarking Population-Based Reinforcement Learning across Robotic Tasks with GPU-Accelerated Simulation, IEEE CASE 2025Asad-Shahid/PBRLNot found

These are non-canonical implementation, benchmark, or tooling resources and do not enter the 270-work or code-first counts. EvoGym is cross-listed with Morphological Evolution and counted once there.

Recent and emerging directions

Accepted papers are separated from canonical preprints and the non-counting watchlist. CORE and LaRes are cross-listed here for recency and are counted only in their primary synergistic branches.

Published or accepted

Canonical preprints and active submissions

MethodPaperStatusCodeGuide
Differentiable Evolutionary Reinforcement LearningarXiv:2512.13399Preprintsitaocheng/DERLEN · Extended
Lifelong Control through Neuro-EvolutionOpenReviewSubmitted workNot foundNot found

Watchlist (not counted as canonical works)

MethodPaperStatusCodeGuide
MEGAModel Evolution Framework with Genetic Algorithm for Multi-Task Reinforcement LearningPreprint 2025; no formal venue verifiedNot foundNot found
Surrogate AE-HNN ERLSurrogate-Assisted Evolutionary Reinforcement Learning Based on Autoencoder and Hyperbolic Neural NetworkPreprint 2025; no formal venue verifiedNot foundNot found
BASILBASIL: Best-Action Symbolic Interpretable Learning for Evolving Compact RL PoliciesPreprint 2025; no formal venue verifiedNot foundNot found
E-SPLEvolutionary System Prompt Learning for Reinforcement Learning in LLMsAccepted at ICML 2026 CompLearn WorkshopLunjunZhang/E-SPLNot found
SV-QD-RLStructure-Conditioned Actor-Critic Branches for Quality-Diversity Reinforcement LearningPreprint 2026; no formal venue verifiedNot foundNot found
NEOLProvably Sub-Linear Two-Timescale NeuroEvolution with Online PlasticityAccepted at IJCAI-ECAI 2026boobaa2001/NeuroEvolution_Online_Learning_NEOLNot found
GERSEvolutionary Bilevel Reward Shaping for Generalization in Reinforcement LearningPreprint; author reports PPSN 2026 acceptanceNot foundNot found
Developmental Reward SchedulesEvolutionary Discovery of Developmental Reward Schedules in Deep Reinforcement LearningPreprint; author reports IEEE ICDL 2026 acceptancealannadels/Evolutionary_RLNot found
HTSE candidateScalable Evolutionary Hierarchical Reinforcement LearningGECCO 2022 Companion candidate; HTSE identity not uniquely confirmedNot foundNot found
Diverse RL Agents with MAP-ElitesEvolving Populations of Diverse RL Agents with MAP-ElitesPreprint 2023; no formal venue verifiedNot foundNot found
Evolving Constrained RL PolicyEvolving Constrained Reinforcement Learning PolicyPreprint 2023; no formal venue verifiedNot foundNot found
RL-GFMGrid-Based Evolutionary Algorithm for Multi-Objective Molecule Generation Enhanced by Reinforcement LearningUnder review at ICLR 2026Not foundNot found
HERLHERL: Hybrid Evolutionary and Reinforcement Learning Method for Macro PlacementIEEE TII Early Access 2026; independent ERL-mechanism verification pendingNot foundNot found
PG-QD Cooperative MARLCombining Policy Gradients with Quality-Diversity in Cooperative Multi-Agent Reinforcement LearningGECCO 2026 Companion short paper; full mechanism or extension pendingNot foundNot found

Contributing

Please open an issue or pull request with:

  1. the paper title and BibTeX;
  2. an official paper URL (publisher, proceedings, arXiv, or OpenReview);
  3. an author-maintained code URL, if available;
  4. one taxonomy branch from this README;
  5. one or two sentences explaining the EA-RL interaction.

To keep the list reliable, unofficial mirrors, generic search pages, and paper pages mislabeled as code will not be added.

Citation

@article{li2025bridging,
  author  = {Pengyi Li and Jianye Hao and Hongyao Tang and Xian Fu and Yan Zheng and Ke Tang},
  title   = {Bridging Evolutionary Algorithms and Reinforcement Learning: A Comprehensive Survey on Hybrid Algorithms},
  journal = {IEEE Transactions on Evolutionary Computation},
  year    = {2025},
  volume  = {29},
  number  = {5},
  pages   = {1707--1728},
  doi     = {10.1109/TEVC.2024.3443913}
}

Contributors

yeshenpy

91 commits

CyanWatts

10 commits

luchris429

1 commits