3. Bake them something. This might be cliche, but everyone loves freshly baked goods. Avoid nuts to make sure your new neighbors won’t be allergic to your gift. Don’t serve them on anything that needs to be returned. That can be an added hassle for them. You can never go wrong with cookies.