Conversation
Bidirectional channel for Erlang-Python communication with: - Sync: receive(), try_receive(), __iter__ - Async: async_receive(), __aiter__/__anext__ - Backpressure via max_size option - Zero-copy buffering using enif_ioq Async support reuses timer dispatch pattern - no new event types needed.
Add channel_send_owned_binary() that takes ownership of a binary and directly enqueues it to the IOQueue without an additional copy. Before: nif_channel_send called enif_term_to_binary (alloc + copy), then channel_send which called enif_alloc_binary + memcpy (alloc + copy). This resulted in 2 allocations and 2 copies per message. After: nif_channel_send calls enif_term_to_binary then passes the binary directly to channel_send_owned_binary which enqueues without copying. This results in 1 allocation and 1 copy per message. For 16KB messages, this eliminates 16KB of unnecessary memory operations per send, improving speedup vs Reactor from 1.6x to 2.0x.
Remove info_msg calls from async_pending and write_ready handlers that were polluting logs and adding overhead on every async request.
- Add docs/channel.md with API reference and examples - Update CHANGELOG.md with Channel API features
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
enif_ioqfor zero-copy bufferingasync foriteration andawait channel.receive()