I'd like to create and ask about best framework for backend end-to-end tests. This is microservice architecture software and the services communicates via REST API and Apache Kafka. What would be best frameworks/libraries for such technologies? The most important is reliability and interoperability of the system.
Start by deciding on the "what" and later solve the "how".
Your overall testing should follow the test pyramid with slight modifications due to the complexity of such a system. Some of the best reading material about it is Martin Fowler, Testing Strategies in a Microservice Architecture and Cindy Sridharan, Testing Microservices, the sane way.
Another good source is from PACT, Introduction to Microservices Testing and Consumer Driven Contract Testing with PACT.
To summarize the sources, they basically say that the focus in the test pyramid should move slightly up. For example you should still invest in good old unit tests but also remember that in a Micro Services environment they are even less beneficial in finding system problems.