Public has every right to be angry about small boats crossings PM says