On a Fire HD 10 (11th generation) the swipe does not work. It worked fine on my IPhone so I know how it should work. Why not just put a button on the screen.
Did you try swiping the other direction? I’ve only ever used iPhone, but I vaguely remember hearing you have to swipe the other direction for androids.