Jump to content

hbarnetworks

Members
  • Posts

    109
  • Joined

  • Days Won

    14

Posts posted by hbarnetworks

  1. 10 hours ago, Tech Support said:

    Protected links need some custom PHP logic to implement them. You can take a look at /admin/tools/cdnapi_aws.php to see how protected links are generated for AWS.

    In order to use it, you need to change streaming type to CDN, copy /admin/tools/cdnapi_aws.php script into /admin/cdn/cdnapi_aws.php and specify cdnapi_aws.php as a CDN control script. You can specify any fake Streaming key to save the server settings. For cdnapi_aws.php the API key used for links generation is hardcoded within cdnapi_aws.php file.

    Awesome I will take a look. I sadly dont seem to have cdnapi_aws.php though. I do have cdnapi.php? Is this the one?

  2. On 6/9/2023 at 4:36 PM, Tech Support said:

    When adding new storage server you can find debug info in Administation -> Installation info -> debug_new_server.txt file. In your case the issue looks to be related to DNS that your S3 access point cannot be found.

    Oright it took a bit but I got it to function. Sadly it only seems to work with direct links. are protected links supported? By any chance?

  3. I am attempting to use Minio S3 as my new storage solution. Which would also allow me to do replication easily. But I am very much confused on what I need to fill in. Pretty sure Region ID is not a thing there. No matter what access I set I always get. Any idea?

    • Put / get / chmod / delete operations failed, insufficient permissions possible
  4. On 5/2/2023 at 11:24 AM, Helmuts DNMUM.com said:

    @Anay Are you coming to TES (Prague) this September? .. it would be great to meet.

    And, what about you @hbarnetworks?

    It would be great to meet KVS users that have found the ways how to deal with traffic you both are getting.

    .. a friend of mine @Westcircle is also coming (his tube network is getting around 2.5 mil/month)

    --

    I am planning to take a small stand there > I plan to attend both European TES conventions every year and will start offering KVS multi-server setup solutions.

    Not quite sure how attending this would make KVS multi-server XD? But no I am not really into going to conventions. So sadly I will not be attending.

  5. I was wondering if below was allowed in terms of licensing. And if this is even a good idea. The idea is pretty simple. I want to centralize KVS on a file-share (nvme server). And then mount this share to multiple front-ends. This way I can just scale it easily by just creating a template of the server and deploying it easier.

    tmp.png.bef8d4972f34ca0227c7616681ae7007.png

     

    Right now I have the below solution where I share TMP - content with the 2nd server. The problem with this solution is that now both servers generate cache files and making design work really annoying because of needed to clear cache :D .

    old.png.626a089dbca6822081839d3e75351944.png

     

    Very curious if 1st option is an option I can work with.

  6. On 4/7/2023 at 4:57 PM, Helmuts DNMUM.com said:

    wow.. what a thread!!!

    @Anay and @hbarnetworks, how many videos do you have? do you remember at which point you started hosting the database/s remotely? looking in the future as one of my clients grows (his main site has around 14k videos and around 1.2mil users/month) > it is super valuable to know what awaits behind the corner.

    great day all!!

    Currently 50k videos with a between 22-25 mil users/month. I always had the database remotely. I have alot of custom features that requires alot of database queries so results may differ. If you have a heavy caching solution 1 database can handle a couple million users easily. (depending on core and GHz of-course)

    I needed to scale more servers not just the database but also the front-end at around 10ish due to PHP limitations

    • Thanks 1
  7. On 3/24/2023 at 8:18 AM, Tech Support said:

    Yes, but then you may get data consistency issues, because it doesn't know if the current read is part of the active transaction or not. Not sure if there are many cases like that in KVS, but usually all background processes are working to read / write data.

    So far I haven't had any issues. I don't think you get any data consistency when you only write to 1 specific server. Granted it is a nvme lan setup so it might process fast enough to not encounter these issues.

    On 3/24/2023 at 11:47 AM, Anay said:

    With  READ-WRITE separation using ProxyQL, do you find any deadlock or other issues. How long you have been running the setup?

    I did not get any deadlocks. but I dont use MYISAM I use INNODB. Which is by itself doesnt really deadlock. However it is not supported in all cases on the KVS platform.

  8. On 3/22/2023 at 8:08 PM, Anay said:

    Hello, 


    We have been handling few high traffic KVS websites for our client and are using cluster of 3 big separate database servers for database load balancing. So far it is working fine and we can handle a lot more traffic now than compared to single DB server setup and that too with comparative lower expanses. However, time to time we are facing Deadlock Transaction issue. They are not much but we assume that in future with more traffic and increased write operations it could be an issue. And simple solution is to separate READ and WRITE operations at APP level. 

    I went through previous multiple discussions here on KVS forums and I see that there is no Load Balancer support for Database yet. However, I was thinking, is it possible to configure KVS to separate READ and WRITE operations. 

    Something in the order that via Config, instead of one DB server, we have ability to specify separate WRITE server and READ server, and if only 1 server is specified then it is used for both READ/WRITE operations. 

    On coding level, though I have not seen any code but I am sure you must be using some custom layer/routine where all queries are centrally processed , so there we can use logic and send queries to separate servers based on function or routine called. ie if write or read. 

    If it is already there or there is quick way around to achieve then would love to hear.

    Hi Anay,

    I have the same setup using a 3 server Galera cluster with proxySQL in front, with proxySQL you can send all write requests to the same server. And send the reads to all 3.

  9. On 1/20/2023 at 12:52 AM, Tech Support said:

    For video thumbnails you configure their compression in Settings -> Screenshot formats. There are imagemagick options there.

    Aah I see. Awesome thx.

    By the way are there any 2FA options in the works? :D? For users as well as administrators?

  10. 21 hours ago, Tech Support said:

    Do you mean where to set JPEG compression level for them, or thumb size?

    Both are possible:

    1) JPEG compression level can be set via /admin/include/setup.php in this option:

    $config['imagemagick_default_jpeg_quality']="80";

    But please note it affects not only members, but other thumbs as well except video and album screenshots: models, categories, channels and etc.

    2) Thumb size can be set in Settings -> Content settings.

    No I am talking about a user uploaded thumbnail as an example. For instance a couple users uploaded 20mb thumbnail images and set that as default. So when they load the kvs.js it first has to load 20mb as for the thumbnail. 😑. It doesn't compress when a user uploads them manually. Unless it should?

  11. On 10/28/2022 at 9:00 AM, Tech Support said:

    Which problem are you referring to? KVS doesn't support HLS at the moment neither at player, nor at system design level, I think they have custom solution. We are working with this.

    I understand that KVS doesn't support it. But for the future this may be an solution on how to deal with downloads. 

     

    I will also create a ticket.

  12. Adding tags has become very awkward. 

    - It sometimes hangs when you want to quickly type and press enter. You have to manually click

    - Copying tags from video to video is no longer possible sinds it doesn't copy the comma in between. But as 1 line. 

    - Performance has gotten worse it hangs on some tags. (it did this in 5.5 as well. But at least you could just enter the tag and press enter without it having to load now you actually have to wait....)

    Also why doesn't a direct match show at the top???

    image.png.eb790508d66c5788f49ff023ba411748.png

×
×
  • Create New...