Long Weekend in Edinburgh, Scotland

Heard this is an easy(ish) trip with nonstop flights from Boston. I want the old stone walkways, gorgeous architecture, little shops, castles, cozy pubs, & a long weekend of wandering around with no plan, just noticing things.