Nicole Richie and Joel Madden Spend Time With Their Little Valentines

Valentine's Day was a family affair for Nicole Richie and Joel Madden. The couple spent the day with their two adorable kids -- Harlow, 4, and Sparrow, 2 -- at their daughter's L.A. school for a special holiday party. As Richie left holding her son's hand, she also carried a stack of Valentine's Day cards and heart-decorated bags filled with what appeared to be candy since both little ones were happily indulging in lollipops -- a rare sight considering Mommy doesn't allow sweets. "Sugar is obviously a big no-no," Richie has said. "No, no, no, definitely no Kool-Aid. There's no juice … My kids don't have dairy either."

Family time is something that will soon be hard to come by for the Richie-Maddens. Daddy Joel is set to jet off to Australia to begin taping the Down Under version of "The Voice," along with Seal, Keith Urban, and Australian pop star Delta Goodrem. Richie herself has her hands full with a reality competition, as well. The House of Harlow designer will be judging the upcoming NBC show, "Fashion Star," with Jessica Simpson, menswear icon John Varvatos, and Elle MacPherson. "I'm really excited and it's something that I'm extremely honored to be a part of," Richie told People. "We have a lot of fun on it."

Will there be more children in Richie and Madden's future? She has always said she wanted five -- twin boys and three daughters to be specific -- and he himself is one of four kids (including identical twin brother and Good Charlotte bandmate, Benji). But Richie has pumped the breaks on adding to their brood for the time being. "I don't think it's fair to ask someone that had two [children] back to back if they're going to have another one," she joked last year during an appearance on "The Talk" morning show. "Right now I'm like, 'Nooo!' But you never know. I need a nap!"

More Celebrity Features on Yahoo!:
Kim Kardashian 'No Cameras' if I Get Married Again
Is Kate Upton Dating Mark Sanchez?
Photos: How the Stars Spent Valentine's Day

Follow omg! on Twitter