Yes covers matter, despite the saying people judge books by the cover, and its a book covers job to tell the reader at first glance what their getting into.
A cover should roughly tell your readers the tone/genre of the book aswell as a focal point.
Your firsf cover is softer, the characters are gazing into eachothers eyes lovingly. The focus is 100% romance
The second cover the characters while embraced, are staring at the viewer and with the swords and the girls outfit being harsher the focus is on the adventure and less romance. More 50-50 split. (It kinda reminds me of those pirate romance books, which if your book is anything like that it'd be a good idea to look at them for inspiration)
Edit- the art and everything in the new one is better. But i think your characters lost some magnetisim by having them stare at the viewer instead of eachother.