Ok, here we go. That took a while.
There's been a number of unreleased features brewing in the last two and a half years (!). Guess I could say I've been cooking some Meth—anol, and now it's ready to serve. What's—my—name? Please don't say Heisenbug.
Anyhow, here's what's new:
- Added a Redis storage backend for the HTTP cache, which supports Standalone & Cluster setups.
- Added the ability to chain caches with different storage backends, expectedly in the order of decreasing locality. This will work well with the Redis cache. Consider the case where you have multiple instances of your service all sharing a Redis setup, you can have a chain of (JVM memory -> Redis) or even (JVM memory -> disk -> Redis) caches, so each node can have a local cache to consult first, and the shared Redis cache after.
- The object mapping mechanism has been reworked to stay away from
ServiceLoader
& static state. We now have anAdapterCodec
that is registered per-client.var mapper = new JsonMapper(); var adapterCodec = AdapterCodec.newBuilder() .encoder(JacksonAdapterFactory.createJsonEncoder(mapper)) .decoder(JacksonAdapterFactory.createJsonDecoder(mapper)) .build(); var client = Methanol.newBuilder() .adapterCodec(adapterCodec) .build(); record Person(String name) {} HttpResponse<Person> response = client.send( MutableRequest.GET(".../echo", new Person("Jack Reacher"), MediaType.APPLICATION_JSON), Person.class);
- Added hip Kotlin extensions. These were enjoyable to work on. Check them out!.
- Added adapters for Moshi. This is mainly intended for Kotlin.
- Added hints API for adapters. This allows carrying arbitrary parameters to customize encoders & decoders. Currently, supported adapters expose no customization. If you think there's a useful, generalizable customization that can be passed to any of the supported adapters, feel free to create an issue.
- Added
MoreBodyPublishers::ofOutputStream
&MoreBodyPublishers::ofByteChannel
to be used in favor ofWritableBodyPublisher
. - Added adapters for basic types in the core module.
- Added the ability to conditionally handle responses with
ResponsePayload
using the basic adapter. - Disk cache writes became considerably faster by avoiding
fsync
on entry writes/updates, which was used to provide durability in a manner that later turned out to be unnecessary for caches. Now CRC checks are used. Reads however became slightly slower. - Added adapters for JAXB Jakarta. They're practically the same as JAXB JavaEE, but use the newer namespaces.
- New
HttpClient
APIs for closure & for setting a local socket address have been implemented. - As of Java 16,
sendAsync(...).cancel(true)
, or an interruption for the thread callingsend
can cancel the underlying exchange. This is made sure to continue being the case even after the Methanol seasoning. - Made
ResponseBuilder
part of public API.
There are other incremental improvements here and there that I may have missed. I promise though your code won't break after the update. If that happens, please file an issue.
Later!
9-5-2022
A full year has passed since the last Methanol release! Time truly flies. It's been difficult to find the time to cut this release due to my senior college year & other life circumstances, but here we are!
-
The Jackson adapter has been reworked to support the multitude of formats supported by Jackson, not only JSON (#45). That means you can now pass arbitrary
ObjectMapper
instances along with one or moreMediaTypes
describing their formats. For instance, here's a provider for a Jackson-based XML decoder.public class JacksonXmlDecoderProvider { private JacksonXmlDecoderProvider() {} public static BodyAdapter.Decoder provider() { return JacksonAdapterFactory.createDecoder(new XmlMapper(), MediaType.TEXT_XML); } }
Binary formats (e.g. protocol buffers) usually require applying a schema for each type.
ObjectReaderFacotry
&ObjectWriterFactory
have been added for this purpose. For instance, here's a provider for a protocol-buffers decoder. You'll need to know which types to expect beforehand.public class JacksonProtobufDecoderProvider { private JacksonProtobufDecoderProvider() {} public record Point(int x, int y) {} public static BodyAdapter.Decoder provider() throws IOException { var schemas = Map.of( TypeRef.from(Point.class), ProtobufSchemaLoader.std.parse( """ message Point { required int32 x = 1; required int32 y = 2; } """), ...); // Apply the corresponding schema for each created ObjectReader ObjectReaderFactory readerFactory = (mapper, type) -> mapper.readerFor(type.rawType()).with(schemas.get(type)); return JacksonAdapterFactory.createDecoder( new ProtobufMapper(), readerFactory, MediaType.APPLICATION_X_PROTOBUF); } }
-
To avoid ambiguity,
JacksonAdapterFactory::createDecoder
&JacksonAdapterFactory::createEncoder
that don't take an explicitMediaType
have been deprecated and replaced withJacksonAdapterFactory::createJsonDecoder
&JacksonAdapterFactory::createJsonEncoder
respectively. -
Added timeouts for receiving all response headers (#49). You can use these along with read timeouts to set more granular timing constraints for your requests when request timeouts are too strict.
var client = Methanol.newBuilder() .headersTimeout(Duration.ofSeconds(30)) .readTimeout(Duration.ofSeconds(30)) ... .build()
-
Fix (#40): Methanol had a long-lived issue that made it difficult for service providers to work with custom JAR formats, particularly the one used by Spring Boot's executable JARs. Instead of the system classloader, Methanol now relies on the classloader that loaded the library itself for locating providers. This is not necessarily the system classloader as in the case with Spring Boot.
-
Fix (46):
ProgressTracker
now returnsMimeBodyPublisher
if the body being tracked is itself aMimeBodyPublisher
. This prevents "swallowing" theMediaType
of such bodies. -
Upgraded Jackson to
2.13.2
. -
Upgraded Gson to
2.9.0
. -
Upgraded Reactor to
3.4.17
.
30-5-2021
-
Added
HttpCache.Listener
. -
Added
TaggableRequest
. This facilitates carrying application-specific data throughout interceptors & listeners.var interceptor = Interceptor.create(request -> { var taggableRequest = TaggableRequest.from(request); var context = taggableRequest.tag(MyContext.class).orElseGet(MyContext::empty); ... }); var client = Methanol.newBuilder() .interceptor(interceptor) .build(); var context = ... var request = MutableRequest.GET("https://example.com") .tag(MyContext.class, context); var response = client.send(request, BodyHandlers.ofString());
-
Fixed disk cache possibly manipulating the disk index concurrently. This could happen if an index update is delayed, as the scheduler mistakenly ran the index write immediately after the delay evaluates instead of queuing it with the sequential index executor.
-
Fixed
TimeoutSubscriber
(used inMoreBodySubscribers::withReadTimeout
) possibly calling downstream'sonNext
&onError
concurrently. This could happen if timeout evaluates while downstream'sonNext
is still executing. -
Made
AsyncBodyDecoder
ignore upstream signals after decoding inonNext
fails and the error is reported toonError
. This prevents receiving furtheronXXXX
by upstream if it doesn't immediately detect cancellation. -
Made the disk cache catch and log
StoreCorruptionException
thrown when opening an entry. This is done instead of rethrowing. -
Methanol
now always validates request'sURI
after being resolved with the optional baseURI
. Previously, theURI
was only validated if there was a baseURI
. -
Upgraded gson to 2.8.7.
14-5-2021
-
Methanol now has an RFC-compliant HTTP cache! It can store entries on disk or in memory. Give it a try!
void cache() throws InterruptedException, IOException { var cache = HttpCache.newBuilder() .cacheOnDisk(Path.of("cache-dir"), 100 * 1024 * 1024) .build(); var client = Methanol.newBuilder() .cache(cache) .build(); var request = MutableRequest.GET("https://i.imgur.com/NYvl8Sy.mp4"); var response = (CacheAwareResponse<Path>) client.send( request, BodyHandlers.ofFile(Path.of("banana_cat.mp4"))); System.out.printf( "%s (CacheStatus: %s, elapsed: %s)%n", response, response.cacheStatus(), Duration.between(response.timeRequestSent(), response.timeResponseReceived())); cache.close(); }
-
Added
CacheControl
to model theCache-Control
header and its directives. This is complementary to the new cache as all configuration is communicated throughCache-Control
. -
Interceptors have been reworked. The old naming convention is deprecated. An interceptor is now either a client or a backend interceptor instead of a pre/post decoration interceptor, where 'backend' refers to
Methanol
's backingHttpClient
. The cache intercepts requests after client but before backend interceptors. It was tempting to name the latter 'network interceptors', but that seemed rather confusing as not all 'network' requests can be intercepted (HttpClient
can make its own intermediate requests like redirects & retries). -
Added
HttpStatus
, which contains functions for checking response codes. -
Added
ForwardingEncoder
&ForwardingDecoder
. These are meant for easier installation of adapters from the classpath. -
System.Logger
API is now used instead ofjava.util.logging
. -
Fix: Don't attempt to decompress responses to HEADs. This fixed failures like
unexpected end of gzip stream
. -
Fix: Decompressed responses now have their stale
Content-Encoding
&Content-Length
headers removed. -
Changed reactor dependency to API scope in the
methanol-jackson-flux
adapter. -
Upgraded Jackson to 2.12.3.
-
Upgraded Reactor to 3.4.6.
-
New project website!
26-9-2020
- Updated dependencies.
- Fix: Autodetect if a deflated stream is zlib-wrapped or not to not crash when some servers
incorrectly send raw deflated bytes for the
deflate
encoding.
27-7-2020
- Multipart progress tracking.
22-6-2020
- Default read timeout in
Methanol
client. - API for tracking upload/download progress.
- High-level client interceptors.
1-5-2020
- Reactive JSON adapters with Jackson and Reactor.
- Common
MediaType
constants. - XML adapters with JAXB.
17-4-2020
- First "main-stream" release.
25-3-2020
- Dummy release.