Knot or not? Confusion reigns about Justin Bieber's marriage to Hailey BaldwinSep 15 (AZINS) American singer Justin Bieber and model Hailey Baldwin have reportedly tied the knot.

A source on Thursday confirmed to PEOPLE that they were legally married at the courthouse. The person also added that the legally married couple will soon have a religious ceremony and celebration with family and friends.

Earlier on Friday, the two were spotted visiting the courthouse where marriage licenses are issued.

According to a report by TMZ, several eyewitnesses said the couple was inside the Marriage Bureau in NYC where Justin got emotional. They added that the 'Sorry' singer was crying and at one point told Hailey, "I can't wait to marry you, baby."

The lovebirds were spotted walking hand-in-hand. The couple kept it casual with Hailey dressed in a casual white outfit and Bieber, in a striped shirt and pants.

But the supermodel, who was the It girl of fashion for the recently concluded New York Fashion Week, took to Twitter to clarify the situation and wrote, "I understand where the speculation is coming from, but I'm not married yet!" The tweet is not deleted from her account which only points at the rumours about the hasty wedding.

The 24-year-old 'Love Yourself' singer took to social media on July 10 to confirm his engagement with the 21-year old model.

After announcing the engagement, Bieber wrote that he will 'lead the family with honour and integrity letting Jesus through his Holy Spirit guide them in everything they do and every decision they make."

He wrote, "Was gonna wait a while to say anything but word travels fast, listen plain and simple Hailey I am soooo in love with everything about you! So committed to spending my life getting to know every single part of you loving you patiently and kindLY. I promise to lead our family with honor and integrity letting Jesus through his Holy Spirit guide us in everything we do and every decision we make. My heart is COMPLETELY and FULLY YOURS and I will ALWAYS put you first! You are the love of my life Hailey Baldwin and I wouldn’t want to spend it with anybody else. You make me so much better and we compliment eachother so well!! Can’t wait for the best season of life yet!. It’s funny because now with you everything seems to make sense! The thing I am most excited for is that my little brother and sister get to see another healthy stable marriage and look for the same!!! Gods timing really is literally perfect, we got engaged on the seventh day of the seventh month, the number seven is the number of spiritual perfection, it’s true GOOGLE IT! Isn’t that nuts? By the way I didn’t plan that, anyways My goodness does feel good to have our future secured! WERE GONNA BE BETTER AT 70 BABY HERE WE GO! “He who finds a wife finds a good thing and obtains FAVOR from the Lord!” This is the year of favor!!!!

This quick wedding does not mean that there will not be a star-studded affair to celebrate the nuptials.

According to a TMZ report, the couple will throw a wedding bash in Ontario, Canada where Bieber recently purchased a mansion worth $5 million.

E! News report quoted sources saying that the couple wants the church to be heavily involved in the whole process. "They had to go through a marriage counselling course through their church which was several sessions long before the marriage became official. They both agreed that they wanted the church to be heavily involved in the process and wanted to follow all of the protocols"