Jim

If anybody makes use of the awempire grabber it would be good to know how? Do you point to URLs on LJ or within the AWE site? What does the embed code stored display?

ok ty

For the marked as deleted case, if the URL is displayed what content is shown and how is this determined/controlled?

If a video is deleted then the video file and URL cease to exist - is this correct? What is the difference between "mark as deleted" and "deactivated"? In both cases the video file and URL remain but the video is not displayed on lists - is this correct? What are other differences and purposes of the options?

In the videos list there is a filter for "content type" (file upload/hosted file/embed code/pseudo video). Can the "content type" field also be added to the columns selection to show the contentent type for each video on the list displayed?

Would adding this previous suggested googlebot allow have the effect of overiding all the general disallows including ../embed/.. , explaining why robots.txt was not blocing crawling? Otherwise the robots.txt file is the same as the kvs default, so I have removed it.

The embed page is not indexed. However, the real issue is that the page crawl is allowed according to the URL inspection below, wheras for the demo URL above crawling is blocked by robots.txt. It appears robots.txt file is not effective in preventing crawling of these "embed" URLs - how can this be corrected? Crawl Last crawl Dec 25, 2023, 7:12:15 PM Crawled as Googlebot smartphone Crawl allowed? Yes Page fetch Successful Indexing allowed? Yes

OK, so you don't have Google Analytics on the KVS Demo site? Is this correct? Is it intended that the KVS CMS makes links on the homepage non crawlable, as reported by Google?

To clarify: Google Search Console lists some crawled URLs as not indexed with reference "Soft 404". The URLs are of the format https://www.mykvstubedomainname.com/embed/83622. This "embed" URL plays the video full screen which is shown on the page https://www.mykvstubedomainname.com/videos/83622/title-of-video-etc-etc Google has only started discovering these "embed" pages in the last few weeks, now there are 45. Is it the case then that the robots.txt file is not effective in preventing indexing of these "embed" URLs and if so how can it be corrected?

Other than minor changes to colors etc the theme being used is the default theme. (CSS file). The desktop view displays four adverts and the mobile one, just simple items fo video etc but the mobile performance is worse. How is the difference between mobile and desktop explained? How does Google Analytics explain the difference between good desktop performance and poor mobile performance? You didn't mention any feedback on the "links not crawlable" comment. This comment also appears on your KVS demo page speed insights link under the SEO heading?

Google Search Console lists some URLs as not indexed with reference "Soft 404". The URLs are of the form https://www.tubedomainname.com/embed/83622. Why does KVS create these URLs, is it correct. They point to a page on the other tube site. What would be the best solution for these pages?

On Google Page Speed Insights for the homepage the desktop performance is good at 91 but mobile is poor at 49. Is this difference typical for KVS? Another interesting result on the homepage is that "Links are not crawlable" with the comment that "To appear in search results, crawlers need access to your app". Does this stop any links off the homepage from being indexed? If so what might be the cause? The adult age confirmation is active on the homepage.

On seobility i notice the sitemap response time is much higher than other pages, and much bigger filesize at 1MB don't know if this is normal or if Google doesn't like it? It also says "3,262 pages have a medium response time between 0.5 and 1 second" whether or not this is significnt I don't know?

This is an interesting subject but doesn't seem to attract much discussion on these forums. Did you make any developments on these aspects? I am taking a closer look at this now as I suspect it needs some attention.

How can you see other tube sites getting indexed? "Copy title" - you mean the video title is grabbed from the original main tube site without changing itm and the page still gets indexed on the KVS tube site?

I'm not too sure, I'm open to suggestions to check out. I will look up some of the notifications from Google later and paste here.

Approx 1,000 pages indexed in over 6 months. I would say not.

Does purchase of the extra open source code de-encrypt all the grabber files?

Please could you clarify the project root folder within this example KVS install: /var/www/fastuser/data/www/exampletube.com/admin/plugins/grabbers

Or this: https://github.com/ytdl-org/youtube-dl/blob/master/docs/supportedsites.md

I'm not sure if this is a definitive or correct list: https://ytdl-org.github.io/youtube-dl/supportedsites.html

In the github link there is a page with "major sites" listed eg facebook, instagram etc Is there a list of tubesites that the default video grabber works on, or can anyone share sites they have tried successfully/unsuccessfully?

Ty for the suggestion. It's added and sitemap resubmitted, hopefully there will be some discovery...

Seems to have worked, thank you!

And step 3, understand the additonal code goes before any existing code in this block - correct? Step 3. In Website UI -> Page components -> include_pagination_block_common.tpl add the following code in the template beginning: