topic Re: URLs for Category Testing in Firewall and Security Management

URLs for Category Testing

Paul_Hewitson — Wed, 08 May 2019 15:43:46 GMT

Hi,

A customer would like to be able to test that a deployed URL Filtering policy is working correctly and blocking or allowing access to different groups of users.

Do Check Point provide a similar database of URLs to that seen at testwebsensedatabase.com (ForcePoint) so that specific categories can be confirmed to be blocked for certain users without having to try and visit a site that belongs to that category?

Clearly they don't want to be trying to go legitimate pornography sites or other questionable sites just to confirm the policy is correctly applied.

Thanks

Re: URLs for Category Testing

Nick_Doropoulos — Wed, 08 May 2019 16:23:39 GMT

Hi Paul,

I'm pretty sure that similar questions have been raised on Check Mates before and I don't believe that there is such a 'database' (not one that Check Point offers anyway). You can verify URL categorization as outlined on sk69200 but no, I don't think there is such a database.

Re: URLs for Category Testing

PhoneBoy — Wed, 08 May 2019 17:22:14 GMT

You can see what category a particular URL will map via https://urlcat.checkpoint.com/
What the policy will be for a given user can't be seen here.

Interestingly, Google Chrome marks http://testdatabasewebsense.com/ as malicious.
Also, the background image for this site is being flagged by ThreatCloud as malicious.

As far as I know, we don't have our own such page, but I'll ask around.

Re: URLs for Category Testing

Tomer_Sole — Wed, 08 May 2019 19:14:54 GMT

http://www.cpcheckme.com/checkme/

Re: URLs for Category Testing

PhoneBoy — Wed, 08 May 2019 23:15:07 GMT

That might work for seeing if malicious content, but it doesn't check if my policy is blocking a specific content category for a specific user.
They aren't known "safe" URLs that trigger the various App Control/URL Filtering categories similar to the URLs we maintain for Threat Prevention blades.

Re: URLs for Category Testing

Paul_Hewitson — Thu, 09 May 2019 08:17:13 GMT

That's interesting. Although it won't test URL Categories for me, it looks like a useful test for whether various blades are functioning.

Re: URLs for Category Testing

Tomer_Sole — Thu, 09 May 2019 08:35:06 GMT

Yes! Are you all green?
Regarding URL tests, I want to believe the names of the categories are self-explanatory and when you pick them, you already know in mind which specific sites you don't want to use. Can you give me an example of a category where you are not sure which examples are relevant?

Re: URLs for Category Testing

Paul_Hewitson — Thu, 09 May 2019 08:59:01 GMT

I've not run the tool Tomer. I would need the customer to run it.

Well an example might be malicious sites. Customer wants to be sure they are blocked without visiting them. Even if they know a URL that is categorised as such, should they be testing to a 'genuine' malicious site to see if the policy works? If it's not configured properly and then they connect to the malicious site rather than being blocked they've now potentially infected or exposed themselves.

Re: URLs for Category Testing

Lich — Sun, 01 Nov 2020 06:02:16 GMT

Any Idea where I can get the list of URLs that the IPS is blocking ?

Re: URLs for Category Testing

Gingerwerewolf — Fri, 04 Feb 2022 11:24:11 GMT

This would be VERY useful as well!

Re: URLs for Category Testing

Gingerwerewolf — Fri, 04 Feb 2022 11:39:58 GMT

Is this what you are looking for?

http://www.cpcheckme.com/checkme/

Re: URLs for Category Testing

AdriMallorqui — Wed, 15 Feb 2023 15:48:05 GMT

Hello, any updates on this case? I am having the same issue, unable to test the configured policies with safe sites. I requested Check Point to categorize test pages from other parties accordingly to their categories (currently, they are all categorized as Computer/Internet), as recommended in sk98489, but they just dismissed my requests without any explanation... Please, if you know of any safe testing pages that Check Point has categorized correctly, could you share them with the community?

Re: URLs for Category Testing

PhoneBoy — Wed, 15 Feb 2023 19:11:23 GMT

Last time I looked (which I admit was a while ago), each URL Filtering category should have a couple of example URLs.
We don’t have a central list, though.

Re: URLs for Category Testing

Chris_Atkinson — Wed, 12 Jun 2024 12:16:31 GMT

Indeed this is visible in SmartConsole / Object explorer as seen here:

Re: URLs for Category Testing

AdriMallorqui — Thu, 16 Feb 2023 10:29:52 GMT

Thank you for your comments, guys. Yes, I am aware some examples are visible in SmartConsole, but let me explain why I think we need safe testing sites anyway:

1- For malicious or content-sensitive categories, we would prefer not to visit the actual web pages. For example, SmartConsole suggests xvideos.com for the Pornography category (do I really need to browse to an actual pornography site to check if my policy is correctly configured?), and no examples are provided for the Spyware / Malicious Sites category, at least in my SmartConsole version (so how do I check it?).

2- For non-malicious categories, some of the examples do not exist anymore (e.g., anonymizer.com), and most of them use only HTTPS currently, and we would like to check the policies before deploying HTTPS inspection.

Re: URLs for Category Testing

Chris_Atkinson — Thu, 16 Feb 2023 13:10:26 GMT

You don't need to browse to the sites you can test URLs here: https://urlcat.checkpoint.com/urlcat/

Re: URLs for Category Testing

AdriMallorqui — Thu, 16 Feb 2023 14:06:52 GMT

I am aware of it, but this is only helpful to see how Check Point categorizes an URL. We want to test if our configured policy is working as expected (so we need to surf to an actual page to check if the firewall is blocking that category).

Re: URLs for Category Testing

PhoneBoy — Thu, 16 Feb 2023 15:57:52 GMT

HTTPS Categorization needs to be enabled (should be by default), but it should not be required to deploy HTTPS Inspection to categorize URLs in most cases.

Re: URLs for Category Testing

AdriMallorqui — Fri, 17 Feb 2023 10:00:38 GMT

As you say, it is not required to categorize URLs, but it is to show the blocking page (otherwise, we only see a CONNECTION_RESET error message in the browser). Nonetheless, the issue with the need to surf to actual pornography pages to check the policy is still unresolved without safe testing pages.

Re: URLs for Category Testing

Chris_Atkinson — Fri, 17 Feb 2023 10:59:24 GMT

Why do you believe that if you check the category of a URL on the URLCAT page and block this category in your policy that it wouldn't be effective?