The doctor will very likely have no choice but to send you to complain to someone else. Not recording will violate policy if that’s what their system is, and it’s an entirely reasonable policy to have. Medical interactions are heavily documented for a reason, and it’s because mistakes can literally kill people.

All your records are already electronic, and a notebook is a far bigger security risk than a cell phone is. It’s not encrypted. Anyone can walk away with it.