Jump to content

hbarnetworks

Members
  • Posts

    107
  • Joined

  • Days Won

    13

Posts posted by hbarnetworks

  1. 2 hours ago, Tech Support said:

    The problem here is not the licensing (since you have purchased satellites this is fine), but we don't have any experience with distributed filesystems and thus we are not able to provide support. If you start using something like this, you should consider to be on your own for supporting this.

    On 4/26/2024 at 2:16 PM, hbarnetworks said:

    Ofcourse I don't expect any support this should be up to the user. I thought it was against the ToS to do something like this in terms of licensing. Because technically you would need only 1 license in order to run 10 webservers. But I guess if licenses are purchased it shouldn't matter.

     

    2 hours ago, Tech Support said:

    There is no any roadmap for this, this is needed for max 10 projects, while there are many other things that are needed for the rest 5000+. Our choice where to put effort is obvious here.

    Syncing website changes to all satellites can be easily automated with some simple shell script and rsync. There is a backup plugin which creates daily backups into tar.gz archive. Each backup contains /website directory, which can be copied to all satellites in order to sync any changes in configuration. You can have a cron script, which will check for new backups in backup directory and then sync the contents of /website subdirectory to all satellites. This will happen automatically on daily basis. Or if you need to manually initiate the sync, you can manually create a theme backup in the plugin to have the new archive synced to all satellites. We think this concept should work well.

    Thanks for the answer. I will try the DFS approach and report back on how that runs. and if that fails I will try the above. 

  2. On 4/24/2023 at 1:41 PM, Tech Support said:

    KVS licensing doesn't allow using single KVS installation on multiple servers. If you want to have load balancing like this you need to purchase satellite license for each installation.

    Each satellite can be installed on a separate server (with NFS connection to the main server, but this is only required if satellite needs to support users upload their content / avatars). Each satellite will have its unique admin panel on a subdomain, and this is the way KVS team can provide support for each satellite, because for support we will need to access KVS admin panel. The only thing which will be different here from a typically satellite site, is that site will be configured to run on the same domain a main domain.com, while admin panel (and KVS license) will be provided to some subdomain (e.g. s1.domain.com, s2.domain.com).

    Right now I have the approach of having 3 seperate servers with 2 sattelites. But the cache generation constantly generating 100k files each server is just a hassle. Running 3 seperate crons adding unessecary CPU and IO cycles. Development on the website is also a pain sinds I need to go to 3 seperate servers to change the files, clear cache, clear opcache. and then check all 3 servers with a hostfile to see if its correct.

    I was just curious if the other solution would work. And adding the main server on top of a distributed file system and letting the webserver server the same filesystem seems to work fine. (ceph or glusterfs). The only thing stopping me right now is the licensing. What if I just purchase the licenses for every frontend server that I have?

    Is there any development roadmap where this is addressed? I am at a point where I need 2 more webservers and going through 5 different webservers just to see if my js file has updated is going to be a nightmare.

  3. On 3/3/2024 at 4:09 PM, Tech Support said:

    You can manually transfer the files and then migration will just verify the files are transferred and will not double copy.

    Ow ye that works aswell but seems like alot of manual work XD

    Is there any reason why the choice was made that there isn't a separate cron for this? Or is it how it has grown and hard to get out of?

  4. On 2/28/2024 at 6:13 AM, Tech Support said:

    We are doing finalization for the fixes and some new features, should probably release 6.2.1 soon.

    It is not possible to run migration in a separate process.

    Is there any other way to speed up the process? This definitely seems like a design choice.

  5. Hi,

     

    I have been having these issues on and off even users are experiencing the same issue and its extremely annoying and causes frustrations. Its 100% an cloudflare issues because the same issue dissapears when I turn cloudflare off.

     

    How can I bypass cloudflare entirely when just uploading? for instance just using an subdomain for uploads as an example?

     

    Uploads through cloudflare simply just breaks from time to time.

  6. Hi KVS,

     

    I was wondering if once HLS is implemented is there also a way to get Edge servers working? I know content servers are easy. But its alot cheaper if I could just grab a 10GB/s server with 1TB nvme and cache HLS parts instead of having another 20TB of storage attached each group.

    Let me know

     

    Thanks!

  7. On 10/30/2023 at 1:05 PM, Tech Support said:

    KVS nextgen architecture finally comes to all categorization list_xxx and xxx_view blocks, including categories, models, tags and content sources. This brings new features to them: more filters, text search, related lists, and - what has been frequently asked - interconnected queries. Interconnected queries will allow displaying categorization that is used together with other categorization in videos, albums or posts. Example: for a model show all categories or tags that are used together with this model in videos. Or for category show all tags that are used together with this category in videos. These queries are pricey, so such blocks should be well-cached to reduce database load.

    Just curious does this mean that if I have lets say a satellite. That I can display only the content/tags/categories/models that are related to that specific satellite configuration?

  8. On 6/28/2023 at 4:30 PM, Helmuts DNMUM.com said:

    Thank you for all your suggestions. Could you please go a bit more on this one?

    --

    .. I am actually thinking of a solution > RClone + Storj

    If you have 3 different storage servers as an example with 3 different datacenters. I dont really see any reason for a backup. If your site is more personal than ofcourse you need backups. But for a P*rn site I cannot backup 200tb of data somewhere.

  9. On 6/23/2023 at 7:55 AM, Tech Support said:

    There is already via import in edit mode. You can export videos with ID and description fields, then open in Excel and mass delete description for all lines. Then import again with empty description in update mode. Should reset all descriptions to empty for the list of videos.

    Ah I did not know that.

     

    Thanks!

  10. On 6/19/2023 at 4:10 PM, naughtyking said:

    i really dont know what is Hetzner storage box. or Snapshooter
    i know that is there two way for backup, one dropbox, but its not recoomend becaouse if you website fall, its will take days and maybe weeks to bring it back, its take time to transfer files from dropbox to your dedicated server if you have big content data like me (20TB).

    and other way to backup is second server that can replace the first server if it fall.

    can you tell me about snapshooter and hetzner storage box? how its work? is it good idea to backup 30TB of data on it?

    You don't really need to backup your content. This seems like an impossible task. Having multiple storage boxes per group 2+ in different datacenters is the way to go.

  11. 10 hours ago, Tech Support said:

    Protected links need some custom PHP logic to implement them. You can take a look at /admin/tools/cdnapi_aws.php to see how protected links are generated for AWS.

    In order to use it, you need to change streaming type to CDN, copy /admin/tools/cdnapi_aws.php script into /admin/cdn/cdnapi_aws.php and specify cdnapi_aws.php as a CDN control script. You can specify any fake Streaming key to save the server settings. For cdnapi_aws.php the API key used for links generation is hardcoded within cdnapi_aws.php file.

    Awesome I will take a look. I sadly dont seem to have cdnapi_aws.php though. I do have cdnapi.php? Is this the one?

×
×
  • Create New...