But some fans stepped in to defend Chandler after the Roloff patriarch shared a photo on social media of the couple out to dinner with some friends.
"Had dinner last night with my great friends.. the Hamill family from Baltimore. #ourlittlefamily rocks," Roloff captioned the photo.
Fans in the comment section immediately got nasty.
"Caryn in every picture she takes with Matt; she just doesn't fit in," one person wrote on Instagram. "The pictures with her in the pictures [with] Matt doesn't seem natural. Like an afterthought. It just looks uncomfortable."
On Facebook, more piled on. "Caryn doesn't need to be in the picture. You don't see Chris [Marek] in all of Amy's pictures. She's in it for the money and fame. Sorry can't stand her," another wrote.
But others stepped in to stop the negativity and defend Roloff's decision to date Chandler.
"If you can't say anything nice about Caryn, don't say anything at all. Matt obviously wants her in his life, and it's his business who he dates," one wrote.
"Praying for all of the sad people who must have no life so they have to down other people," another added.
A lot of people coming for Matt seem to still be holding on to his relationship with ex-wife Amy Roloff, with whom he split in 2015. And while Matt has earned the anger of fans by moving on with Chandler, Amy has likewise been criticized for her relationship with boyfriend Chris Marek.
In an April episode of the series, Amy opened up about how her split with Matt affected her, as well as her future with Marek.
"Divorce was a very traumatic chapter in my life," she said. "I didn't think I would ever even want to be that vulnerable with someone again. But now being with Chris, I like the fact that I'm able to open up myself to someone else."
The two are keeping things casual for now, she added.
"My relationship with Chris means the world to me, but nothing is written in stone right now," Amy said. "Especially because he initially said he wanted to take it one day at a time. ...That definitely plays heavy on my mind, on my heart," Amy said of the moment. "Where is this going? Where do I wanna go? Where does he wanna go? Where are we going together? I definitely think that is something we need to figure out."
Photo credit: Instagram/Matt Roloff