RPC with RAII and coroutines
"I will be demoing a project that I call Canopy. Coroutines were made for RPC add a layer on top and you get remote lifetime management with RAII with shared and callable weak pointers. It is agnostic on serialisation formats internally supporting binary, protocol buffers, and JSON (flatbuffers coming soon), though for normal application development you will tend to use the fastest and not think about it. It supports several different forms of transports currently tcp and ipc are the most advanced but io_uring will be coming soon. It encourages you to move your headers into IDL so that interfaces can be marshalled and your C++ code is self contained in .cpp files. The idl gets translated into json schema and .proto files for connectivity to other systems that are written in other languages.
I will be demoing how you can connect to a websocket from a browser and call into a llama.cpp instance, showing composed tcp, tls and web socket streams that connect to the transport classes that connect to the marshalled objects."
Edward Boggis-Rolfe
I have been working on the tooling side of application development for the past 30 years trying to move away from boiler plate code to machine generated logic that hides the glue logic that most applications have to write tonnes of. I have been toying with coroutines for the past 15 years before I knew their name.
More recently I have been working in trusted execution environments using mainly SGX enclaves to secure applications, it was from this I implemented a blocking RPC solution that used YAS that supported binary and JSON streams. From that I implemented Canopy which extends this to supporting other serialisation formats such as protocol buffers so that gRPC supporting web clients can easily connect, and to add full coroutine support.