Duplicate posts since 10 days. No changes made | CyberSEO Pro | Support Forum

There are many thread about it at this forum. The solution is the same as it is described in the plugin’s documentation: don’t use the manual RSS pull mode. Use server cron instead: Login to see this link

I haven’t changed the duplicate detection algorithm in CyberSEO Pro and your feed with its feed settings does no generate any duplicate posts.

Now see what could happen. Your WordPress database grows up consonantly and now it contains 44,666 posts. That’s a rather large base and every time when the plugin pulls a feed, it check every post there towards every post in your database via a MySQL request. Every single time for every single post to make a new one is not syndicated already.

This takes some time, depends on your server capacity. According to your post above, the cron does it every two minutes and just forces your server without a reason. Thus when it runs for the first time, the plugin starts to pull every feed and check all posts there towards every post in in each feed. Since it happens every 2 minutes, your server just may not finish the check when another process will be started at your server to do the same work.

So they do it at the same time. The new post is not in the database yet, so when the 1st process finishes, it adds that post, but the second process is still running. It doesn’t know that some other parallel process has done is already and also adds that post. As a result, you have two same posts in the database.

My advice is to increase the trigger period for your cron from 2 minutes to say one hour. I believe that you have no feed sources that publish a new post every two minutes. A human copywriter or a blog owner just can’t compose and publish new posts that fast.

This will fix the duplication issue and stop forcing your server hardware in a barbaric way. Your server’s HDD has a limited resource. Save it and don’t let it die in a year.