WordPress, Contact Form 7 not sending emails, no confirmation, no error

Contact Form 7 is indeed a very powerful plugin and a great contact form for your wordpress. Still,  a lot of users report that email sent with Contact Form 7 are not received, or not sent or even that there is no error about it.