May 4, 2011

Pulling Feeds Timing Out | CyberSEO Pro | Support Forum

Avatar

Lost password?
Advanced Search

— Forum Scope —




— Match —





— Forum Options —





Minimum search word length is 3 characters - maximum search word length is 84 characters

sp_TopicIcon
Pulling Feeds Timing Out
Topic Rating: 0 Topic Rating: 0 Topic Rating: 0 Topic Rating: 0 Topic Rating: 0 Topic Rating: 0 (0 votes) 
May 11, 2022
4:02 am
Avatar
tshutt
Member
Members
Forum Posts: 23
Member Since:
January 7, 2022
sp_UserOfflineSmall Offline

Pulling our RSS feed to publish is timing out every time and gives Cloudflare 524 error and sometimes 503. I had an AWS admin look into the server and he assures me the server is great and that the issue is with the CyberSEO plugin. The site I’m working on is: Login to see this link

Is there any possible bugs or settings that could be causing it to consistently time out? I already maxed out the Memory_limit and Execution_time. 

Any help would be much appreciated, thanks!!

May 11, 2022
11:51 am
Avatar
CyberSEO
Admin
Forum Posts: 3635
Member Since:
July 2, 2009
sp_UserOfflineSmall Offline

Sounds like CyberSEO Pro has a special code which checks if it runs at “Login to see this link” and then decides to generate a 524  message :)

No, it’s not. The plugin has no such a code and it has no bug which generates the 524 gateway timeout error. That’s your PHP engine which is unable to complete the operation within some specified time frame. It’s controlled by the PHP max_execution_time directive and usually is limited by 30 seconds.

You can always alter this value to be sure that your server has enough time to complete the task: Login to see this link

May 12, 2022
1:54 am
Avatar
tshutt
Member
Members
Forum Posts: 23
Member Since:
January 7, 2022
sp_UserOfflineSmall Offline

Obviously I understand the plugin wasn’t throwing up the 524 error. It’s causing the server to timeout which is causing the error, but I already have PHP memory limit and execution time maxed out. I guess there’s no solution. Thank you.

May 12, 2022
12:14 pm
Avatar
CyberSEO
Admin
Forum Posts: 3635
Member Since:
July 2, 2009
sp_UserOfflineSmall Offline

There are many solutions to optimize the process. You can decrease the number of feeds you pull at once, you may try to disable translation, content generation (e.g. ArticleForge), spinners etc to decrease the syndication time. At least you must study the “Syndication log” to see which exactly feed your server has a problem with.

May 13, 2022
6:48 am
Avatar
tshutt
Member
Members
Forum Posts: 23
Member Since:
January 7, 2022
sp_UserOfflineSmall Offline

All of those settings were already set but I may have found the cause in the Syndication Log. I took this to FIFU support first but they said it’s on CyberSEO side…

Her’es the log:

[13-05-22 12:05:28] Trying to generate post thumbnail from the media thumbnail(attachment).
[13-05-22 12:05:30] The post thumbnail has not been set because FIFU is not active or the image source is invalid.

It says FIFU isn’t active or the image is invalid, but FIFU is active and the image URL is valid. It seems like FIFU failing may be what’s stopping the feed… Is that by chance something you’ve ever experienced? Or maybe know of a workaround?

Thanks

May 13, 2022
12:01 pm
Avatar
CyberSEO
Admin
Forum Posts: 3635
Member Since:
July 2, 2009
sp_UserOfflineSmall Offline

That’s not on FIFU side and that’s not on CyberSEO side. As the log says it’s on your side. I need to see the full log to be sure that the image is correct. Also it can’t be a reason which caused your server to fail.

BTW, you may always disable FIFU in the CyberSEO feed settings and see what will happen then.

You haven’t even posted a link to your feed. I can’t fix a broken car without looking under the hood.

May 14, 2022
5:11 pm
Avatar
tshutt
Member
Members
Forum Posts: 23
Member Since:
January 7, 2022
sp_UserOfflineSmall Offline

Thanks for your responses, the syndication log was very helpful.

In case someone else encounters this issue, simply disabling the FIFU setting in CyberSEO then pulling the feed seems to fix it. Then I was able to re-enable FIFU setting, still works. 

May 14, 2022
5:22 pm
Avatar
CyberSEO
Admin
Forum Posts: 3635
Member Since:
July 2, 2009
sp_UserOfflineSmall Offline

That’s just a coincidence and it doesn’t fix the problem. Thу issue disappeared because this time your server was able to pull the feed and generate a thumbnail for it via FIFU.

In your case it seems that your server is just unable to parse all the posts in the RSS feed because your max_execution_time value is too low. When a plugin is able to generate a thumbnail for the 1st post, it just quits parsing the feed. But if it was unable to generate it, it continues to try the same operation with another post and so on till the end of the feed. In this case the parsing time increases from one post processing to all posts in the feed. And here you’ve got a server error message.

The only way to avoid it is to stop playing with options and increase the max_execution_time value at least twice. And don’t forget to restart your web server to apply the changes.

Forum Timezone: Europe/Amsterdam

Most Users Ever Online: 541

Currently Online:
6 Guest(s)

Currently Browsing this Page:
1 Guest(s)

Top Posters:

ninja321: 84

s.baryshev.aoasp: 64

Freedom: 61

MediFormatica: 49

B8europe: 47

saviulisse67: 45

Member Stats:

Guest Posters: 338

Members: 2602

Moderators: 0

Admins: 1

Forum Stats:

Groups: 1

Forums: 4

Topics: 1518

Posts: 7666

Newest Members:

test.test, david_alija, paypal.orasmarketing, brad.lee.coates, Thatcham Town Radio, drew.jmediagroup

Administrators: CyberSEO: 3635