Some good and sage thoughts from Put This On on how to built a great wardrobe:
Which is why, if you’re just starting to build a wardrobe, you should focus on the best fitting basics you can. A perfectly fitting navy sport coat will be better than five in the closet that are slightly off. That navy jacket can be worn multiple times a week without anyone noticing, and the resulting outfits can be made to look different by relying on a very minimal neckwear collection. Similarly, a pair of chinos, jeans, and two grey wool trousers can be relied upon multiple times a week, but they must fit excellently. Spending as much as you can on just three to five pairs of pants will be smarter than having fifteen that are too slim or baggy for your build. Fit is the first requirement; stylistic details and accessories come after.
In short, buy less, but definitely buy better and make sure everything fits well!