Ja Rule left a state prison on Thursday, only to be immediately taken back behind bars. The hip-hop superstar completed his sentence for weapons charges, but now faces more jail time for tax evasion.

The 36-year-old rapper, born Jeffrey Atkins, left an upstate New York prison on Thursday morning after serving 20 months for illegal gun possession, reports the AP. He must now serve the remaining time on a 28-month sentence for failing to pay taxes on more than $3 million of earnings.

According to his attorney Stacey Richman, Ja Rule may be released in six months and may be eligible for a halfway house. He plans to get back to work so he can pay off back taxes.

He reportedly owes the IRS $1.1 million, but it’s unclear how much, if any, has been paid. Once released from custody, he also faces a year of supervision.

He is already looking forward to getting back to music and attending his daughter’s graduation. “He’s a devoted father,” said Richman.