I had a similar experience with small doses of Adderall. It would improve my focus, but it left me feeling anxious in the evenings.

What helped in my case was consistency. I took the meds every weekday for a month and slowly the anxiety lessened as my body got used to the meds.