The Arab League withdrew a speaking invitation to the pro-Palestinian Swedish foreign minister when they realized she would discuss democracy and human rights.