Feature Request - To prevent redundant url processing | CyberSEO Pro | CyberSEO support forum

What do you mean by "processing the same URL multiple times"? If you're referring to different feeds importing the same URL independently, that's expected behavior. If you mean multiple processing of the same post within a single feed - please provide a log example. The plugin logs each cURL request step-by-step, so if that's happening, it should be visible.

As for storing processed URLs in a separate file - that's redundant. The plugin already checks for duplicates and applies filters during processing. An external TXT-based log wouldn't improve this process and might even slow it down.

In your example, the article wasn't published because it didn't pass the post filter due to insufficient content length. Since it wasn't added, the plugin didn't save its URL - and the next time it ran, it processed the same article again. This is expected and intended.

CyberSEO Pro keeps track of all successfully imported posts by storing their source URLs in the database. It compares each new item in the feed against this list to avoid duplicates. But if a post hasn't been added - due to filtering, extraction failure, API issues or anything else - the plugin will try again later. This is not a technical oversight, it's part of the core logic of the plugin.

Let's say you had a filter that blocked posts under 1000 characters. A post didn't pass, so it wasn't published. Later, you adjust the filter to 800 characters - or the original article is updated and now meets the requirement. Should the plugin ignore it just because it failed once? Of course not - that would mean permanently losing relevant content based on a temporary condition.

Also, just to clarify, what you shared is a compilation of two separate logs from different times - two independent attempts to process the same feed item. This is normal behavior and confirms that the plugin is working as intended.