JEP 210: LambdaForm Reduction and Caching

AuthorChristian Thalinger
OwnerVladimir Ivanov
Created2014/06/12 14:33
Updated2015/02/27 18:49
TypeFeature
StatusClosed / Delivered
Componentcore-libs / java.lang.invoke
ScopeImplementation
Discussionhotspot dash compiler dash dev at openjdk dot java dot net
EffortM
DurationM
Priority2
Reviewed byBrian Goetz, Mikael Vidstedt
Endorsed byMikael Vidstedt
Release8u40
Issue8046703

Summary

Reduce LambdaForm creation and use caching to improve the performance of dynamic languages.

Goals

Considerably reduce memory footprint while preserving current peak-performance metrics.

Motivation

Many method-handle transforms (e.g., MethodHandles::filterReturnValue) create many new LambdaForm instances for each transformed method handle. This induces excessive memory usage in applications that make heavy use of method handles.

Description

The current method-handle implementation instantiates LambdaForms too aggressively. The proposed approach is two-fold: Share LambdaForm instances and their bytecodes for similar transformations, and cache lambda forms for different combinators on a per-basic-type basis (see MethodTypeForm.lambdaForms).

Testing

Existing tests give good coverage of functionality. Some focused tests (i.e., white-box tests verifying actual sharing in different cases) are also desirable.

Existing tests:

Testing modes:

Risks and Assumptions

The implementation shouldn't cause any regression in peak performance. Experiments show, however, that preserving peak performance may prevent maximal sharing in some situations (e.g., MethodHandles.guardWithTest, where profile pollution due to sharing distorts inlining decisions of JIT compiler). We'll need to find a suitable balance between footprint reduction and peak performance during development.

Impact

The changes are concentrated in Java portion of the method-handle implementation (i.e., the java.lang.invoke and sun.invoke packages). There is no impact upon those who don't use method handles. No new APIs will be added and no existing APIs will be changed.