Testing Spark Streaming: Integration testing with Docker Compose

Testing Spark Streaming: Integration testing with Docker Compose

In the first post of this series, we saw how to unit test Spark Streaming operations using Spark Testing Base. Here we'll see how to do integration testing using Docker Compose. What is Integration testing We previously saw a discussion about unit and integration testing....

Testing Spark Streaming: Unit testing

Testing Spark Streaming: Unit testing

There is enough evidence to prove the importance of automated testing. Projects in new fields often neglect automated testing, as the domain itself steals the attention of the developers. However, lack of testing implies 'laugh now, cry later'. Some of the tools around Big Data...

Codurance Logo

Software is our passion.

We are software craftspeople. We build well-crafted software for our clients, we help developers to get better at their craft through training, coaching and mentoring, and we help companies get better at delivering software.

Latest Blogs

Useful Links

Contact Us

15 Northburgh Street
London EC1V 0JR
Phone: +44 207 4902967

Carrer Aragó, 208
08011, Barcelona
Phone: +34 689 723 737

Email: hello@codurance.com