You can go the Privacy and Security settings and choose the length of time after which a password is required. You could make this longer than you currently have set.