are the roots of a weed plant strong enough to grow through clay dirt? i didn't have enough soil for my last couple plants and i was jw
it will probably be OK but I would worry about how much water that soil will retain. you can loosen clay soil with gypsum and perlite.