Video ID: 1hA2ehAKGDQ
YouTube URL: https://www.youtube.com/watch?v=1hA2ehAKGDQ
Added At: 13-06-25 21:18:51
Processed: No
Sentiment: Neutral
Categories: Tech
Tags: AI, Machine Learning, Home Lab, Local Processing, Data Control, Chat GPT
Summary
• The host and guest discuss the Nvidia RTX 4000, a device that can run AI models locally without requiring external power. • They talk about the benefits of running AI models locally, including being able to control what data is uploaded and having more control over the processing. • The guest mentions that he's been using chat GPT and exploring other AI models for their home labs.
Transcript
welcome to the home lab Show episode episode number 121 with a special guest Wendell how you doing Wendell how's it going thanks for having me oh we're excited Wendell has a cool little device that we're gonna be talking about and this dub Tails perfectly we talked about how easy it is and it's amazing how easy it is we'll talk about this some more to get started with AI in your home lab where you don't have to upload your data to some company you can start deploying these and uh it's just going to be a fun we're just gon to RI on some home lab stuff today we we don't have to have a really strong we just have a couple ideas we want to talk about there but I think it's going to wander in some good directions here because that that little card that wentle uh 70 watts is that what you said 70 Watts this is the RTX 4000 sfff Ada generation which is a mouthful but that's it's new but it's it's an RTX 4000 70 Watts so it doesn't require external power it's half height it is not single slot unfortunately because it's got a pretty pretty good cooler but it's got 20 gigs of vram ECC vram and so this if you want to run an llm locally like for o llama 20 gigs I want to run a 14 billion parameter model at real time token realtime levels of token processing this is amazing wow kind of makes me want to try it out I haven't haven't done that yet but that should be something I should try out uh the large language models but uh so sorry what was that called again that device this is a Nvidia RTX 4000 uh sff Ada generation one more time can you say it one more time I'm Kidd we will have to put that in the description do you have a video on it yet Wendell ones I'm working on it I I was I was not expecting to be impressed by this little thing but it is in a 70 wat power envelope I am genuinely surprised how how fast it is um for doing local stuff like if just if you just want to like load it up with oama have you have you messed with AMA that's one we talked about last time so that's why I figured it's I'm really impressed I know mol's got a new one that's claiming I I it's uh invite only that's supposed to be rivaling chaty B for that you can run your home lab I haven't tried I've tried the um dolphin mistal uh the Co in the code llama and I'm getting better at it I'm still very new to it because I've been using chat GPD because it's there and I kind of want to get off of the dependence because I'm always careful about any data that I upload to it I'm make sure it's not anything um that so that's why I started playing with the local ones because I just I want to be able to have control over what goes into these things or not worry about what goes into them because I'm the one hosting it yeah exactly and and you can also start doing fun experimental things like giving it control over things in home assistance so you can just say hey home assistant did was there anybody on the porch today or you know hey home assistant like I'm leaving now deal with that and it's like okay let me turn the air conditioners off and whatever so I haven't tried neon yet but that's something on my list I'm not talking about like the the neon OS well it is an OS it's just not the KD plasma one it's confusing the one specifically for um a replacement for the micro software since M well it's not replacing it's not made just for that but it's like the um chosen path forward and I almost wonder if that would hook into that so if I had my automated assistant have uh be backed by a language model then I think that would be a great interface to get through to talk to it and make it do stuff yeah that's the great thing about AMA is that because it's just an API you can do a little shell script or a little python script or whatever you want to do and uh there was a guy that did a blog post I think this kicked off home assistants I haven't looked into this but supposedly there's like a home assistant hackathon or something for llms I don't know if that's like I I just saw that somewhere and I was like I need to go back and look at that and I haven't gone back to find that but somebody wrote a blog post on training their llm to Output direct Json that they could feed into home assistant and it was like kind of the starting point that kicked off everything and it's like yes that's this is the way it it's Star Trek level like computer yeah there's a um you know a lot of the AI has to do with prompting and I mentioned last time uh and it's a really cool GitHub project called fabric by Daniel Mesler and I don't know if you've looked at it but he's run an amazing job of building everything with a lot of really solid prompt engineering for example he's a security researcher so he wants to you got the news here's a security problem what he does is he actually takes it and comp pointed at news articles and it outputs into a standard Json format so he can import it so we can understand the vulnerability what it you know so he can read between the lines and figure it out and it does an excellent job of analyzing it it's kind of something you may not think about with LMS but it's not hard to tell them say hey this like the security research I was doing with this screen connect thing I actually just used the LM I'm like all right here's the IPS I just need all this outputed in CSV here's the input from showan with all the lists uh we're going to filter it by State we're going to come up with a list I need to know the uh header for this and I'll put all this in CSV and it made the list for me that I'm calling from like because I'm not that great at scripting wow that's amazing the the up up to now I got to do something more clever because up to now the most noteworthy thing I've done with um AI is I had chat chat GPT explain the kill command in Linux as if it's being explained from or by a klling on from Star Trek and it's just which is perfect use absolute gold but um or um the ls command explained by Regina George for Mean Girls is another fun one but as far as actually something productive um I've had mixed results but it's definitely coming coming along um as far as chat GPT is concerned I know that's not the um we can't self-host that but it is kind of like the precursor I think that gets a lot of people interested in this and the next thing you know they're running 10,000 servers in their basement yeah it it's a it is a little bit of an explosion I mean I the question for me is on for the curve that we're on are we on like the 1960s like look this is a Mercury delay line and we haven't invented transistors yet because things are accelerating and shrinking at such a rapid pace and also there's stuff like um I've seen some really just mindblowing demos of software like neural magic to take it to take these neural Nets and sparsify them so that they run on CPUs because you know CPUs it's fun it's like oh all of a sudden your 128 or your your 64 to 128 core x86 C is suddenly very useful for doing these kinds of things and also pairing down the complexity of the neural net so that it you know it's like a 17 billion parameter model is almost as good as a 90 billion parameter model with the appropriate you know tuning and this kind of thing and so the utility of these on it's going to be faster than what we saw even with like cell phones to go from like the suitcase phone to like the giant you know cancer brick phone to like what we have today is going to seem like a lifetime compared to how quick these these things move I think I I kind of agree because it's become affordable to train these because someone was breaking down the costs uh we had some when we have some more servers coming they're for clients but you know they make a pass through our office while we set them up so we plan to do a little bit of testing on some of them and it's interesting because they're I'm gonna put them in pseudo affordable they're not outlandishly expensive but even if you just rented the stuff in the cloud someone told me it's cost around two grand to do each one of these training models I'm like that's not crazy that's within realm of a business who want to train on their own data to build one of these customized models out like you said a a scale down but let's focus it on we're going to train it on data we have two grand for training not not old landish yeah yeah it's amazing how how it's going I almost wonder if we're seeing the end or the beginning of the end of the keyboard and mouse as input devices and I know there's lots of people are like you'll fry my mechanical keyboard out of my cold dead hands I'm not talking about those people I mean just like the average you know non teie just checks their email and you know keyboards and mice I think I mean know obviously it's more than that but I feel like um it it's strange to me because as a kid I would have thought by now we'd not have any input devices we talk to our computers but here we are the keyboard and mouse but now finally like you're saying the warp drive or you didn't say warp drive I was thinking warp drive um talking about inventions and things and how it's uh really ramping up it is kind of um I think we are on the cusp of something with the AI and I know a lot of people rolling their eyes right now but believe me if uh you we we're not bandwagon people here we don't jump on bad bandwagons and Chase Trends um we um we get excited about something it's probably for a reason so this is some cool stuff yeah this is this is the most exciting but it's it easily turns into a black hole and it's it's also uh it's also you know sometimes I feel like a parrot like I I knew somebody that had a pet parrot and the pet the parrot was always obsessed with the reflection of themselves in the mirror and I worry that some of the AI stuff is a little bit like the parrot it's like oh this is a reflection it's like but it's not actually doing anything useful like I'm spending a lot of time with this but like is it really is it like actually super handy I I don't know I think there's Outer Limits episodes and probably um other sci-fi shows that cover this topic in detail what exactly happens when it has a it has an you know an opinion of mankind based on the data it ingested but then it uh thinks we're evil or something well I tell you I tell you the test this this this will set your mind at ease when you're playing with all these llms ask it to play a game of rock paper scissors and and tell it to go first and then after you win 10 times in a row ask it if it has any idea how you're winning yeah oh that's fun it doesn't know it's just like I don't know you seem really lucky and it's like okay cool there's a lot of things it just doesn't understand uh and I I was looking over because I remember the name of the article but this is a article I can add it to the description here um it well research paper done at Cambridge very recently published uh like last week and I took the time to read it because it really highlights that it's an assistive technology and it's really interesting one of the lines I pulled from it was in a case of cosmic irony AI is not trustly with facts and numbers like I love the person very realistic it does respect it does not respect rules AI is however remarkably effective at acquiring knowledge acquiring tactic knowledge uh rather than relying on hardcoded procedures AI learns by examples gains Mastery without implicit instruction and acquires capabilities that it was not explicitly engineered to possess they kind of go on of the whole purpose of the paper is go this isn't the end of work this is the end of jobs this is just another tool and those who embrace it as a tool are going to have the most success I mean there's always somebody going can I replace my entire department with AI that's definitely the trend we're seeing pushed for but that's not a realistic but in in the case of like I used it for this morning of parsing a bunch of data that I didn't really have time to write a script for um it does a great job of that but it also screwed up on some of it because it just decided something I looked at the output and said you're completely ignoring something I told you to do and I told it that I said you've ignored the curl DK command you know the insecure ignore the certificates and it says oh I will fix that and I told it to do it implicitly at the beginning it just decided not to which of course made it give me an error instead of the result I wanted so it is kind of weird how it just does something on its own even though you told it to do something else but if you put it in the hands of an expert so who has a general idea what you need done you understand where the flaws are and it got me 90% of the way there I just prompted it one more time to fix the stupid it did and then I fixed it right that's an an interesting thing that it's interesting you bring that up because that's something I've noticed about running local models and some of that like I guess what that's referred to is like the number of local tokens that are supported for context and so um I've noticed that with local models you can set them up so that you can ingest Millions of tokens to give it context like here is the entire code base and I would like for you to look for these common security issues in the case of a an AI coding model that has been trained by meta or whoever and it's it's surprisingly good um there was I saw I need to actually saw this morning and I was going to read some more about it sometime today if I had time someone took their code repository and their GitHub issue queue and just used one of the local models that had an absurd token length and they fed it their codebase and they fed it their issue que and they actually got two or three useful patches out of that to solve those issues that were described in the issue queue and it was little more work than ingest the entire code base for context in just the GitHub issue feed and it's like all right let's get to work what do we got to do here it's like well this might fix it what do you think it's like yeah this is a good idea fixed done didn't really have to put as much work into it yeah is cool I I think those are some of the edge cases you know just before I jumped on here and something I mentioned because I did a live stream about it was that there's a major flaw and a major tool used by a lot of people that is causing chaos at the moment and uh AI can do good fuzzing at things and help security researchers as once again aist of tool to find silly things that they have overlooked when they've uh wrote their code and you know leads to a big vulnerability and everyone having a panic attack over it I think those are going to be really good future uses for it because we just don't have enough security researchers for all the software to gets built out there I mean we have good coding practices now but um the reality is the long tale of Legacy keeps slapping us because well we know there's a new product that was written in a modern architecture but this one written for 13 years ago still works like so um I want to Circle back though what is the price point on that Nvidia device there so I was going to ask the same thing I think these are around $1,100 so you're still better off with a gaming GPU if you go that route but very low power and very uh very uh Sleek yeah 70 Watts like you're got it's like I'm gonna underclock a gaming GPU okay maybe kind of I mean but yeah exactly I mean it's just so cool that some of the hardware that's coming out um especially considering you could buy a you know like a PCI board with raspberry pies on it just like craz yeah well and I 70 Watts matters a lot one of the challenges is those super micro AI systems um and one I it's the same one I reviewed on my channel it's it almost 4,000 watts at full load yeah thing is W so we ran into two problems first we had to plug his four power supplies so two power supplies plugged into one side of our lab another one pled to other side of the lab second problem is we left the door closed because it was so loud and then we realized that the lab which is a pretty big room it's about a 20 by 30 room or so it was really hot in there we're like okay the lab is now because we were uh running hash cap we wanted to see just how many passers we could crack and uh which was amusing but also we actually got we were like okay I think it could be approximately 90 degrees in this room and it's winter here in Detroit for those who don't know it's what well I mean is it winter because I don't even know what season it is this year from one day to the next oh yeah beautiful today I think we have like 55 degrees we we were at like 20 degrees the other day we're back up to 55 so it's just like random it's like a random number generator is our forecast for this year throw a random number out there so what are some of like the do you have any hidden gems for home lab wendle like like some it could be something like that or anything else that people don't really realize they could use or anything that uh we may not have talked about I what's new in h lab anything on your radar um I really like the direction so at the bleeding edge if you're willing to get your hands dirty and that kind of stuff I I really like the direction everything is going in with home lab and home lab integration and like the proliferation of like standards compliance sensors where you don't need cloud-connected stuff and and and also the fact that there are some really amazing viable tools that will probably get a nice slick gooey in the next year or two for doing things like managing home security and cameras and asset protection but also just things like hey the water's running and no one's home that's weird I should probably turn that off like yeah that kind of stuff that kind of quality of life stuff is is really not because you don't always notice it's like oh that somebody you know the garden hose thing is leaking on the side of the building I I never would have noticed that unless it was like Hey the water's running at like three o'clock in the morning for like an hour that seems weird that's outside your us pattern the um I funny to mention it I just went on a full task around the whole house I now have I mean they're so inexpensive I think they're by zoos the water sensors they're inexpensive they're all over my house uh I have home assistant set up to do push notifications on my phone my wife's phone and uh we've already had one get tripped and go off someone good news it wasn't actually a leak someone just tipped over uh something under the sink and soaked my water sensor so it wasn't actually a SN because we got them we put them on it us they're so cheap I think they're like I don't know they were on sale for like 15 bucks so I bought a bunch and um you know we had a dishwasher problem but those little things like that I don't want to trust some third party that maybe has something and matter of fact the battery life on these is people were saying like a year or two and I'm like wow this is kind of great it all ties into a home assistant they have zigg models zwave models do you know I have zigby and zwave on my home assistant but I think you're right seeing a lot of these devices and I have a little little one in my hand um that I use just for automation all these little touch buttons and then you can program it and I'm like I have no Cloud dependency if the internet's out whatever I can control my home and I never thought about this because I've never used any of the cloud ones but one of the things people my friends my neighbors because they're normal people who just use Alexa for everything um they were impressed you're like when you touch the button on your phone it's instant ours like delays I'm like like oh yeah it probably makes sense that the cloud one sometimes delays and they like sometimes we just finally get aggravated and turn the light switch on I'm like oh yeah I touch it it's like all local so it's 100% like there's like this immediateness to it I love that well you can't really sell the comment uh the internet's down so we can't turn our lights off that there's no one nobody in the house that's going to feel like that's an acceptable thing to say like what we need the internet to turn off a light switch depending on how it's set up obviously but then of course light switch is you you have them turn off and everything comes off the network so you always have the spouse approval Factor if you live with somebody that they may not care about all this stuff excuse me but they want it simplified so I thought about these and I'm going to try them these wallmounted buttons that they're not like the normal like if you rent you're not you're not wanting to do surgery on your electrical inside a house you don't own so you s on I got know battery operated little things with a command strip you just stick on the wall has a single button on it and you just put a script behind the button and call it a day but um that's what I'm that's something I'm going to be looking into as well I know it's relatively entry level but sometimes it's those simple things that make home assistant like hard to sell inside your own house because some people just think it's complicated I'm still using the uh the Lutron switches that are drop in 110 volt but they have the optional like stick on battery operated ones and their buttons are reprogrammable but you have to get the bridge to do it and it still works with home assistant and everything else I don't know there's probably something better by now because those switches are a year or two old but I'm hoping that you know people sort of catch on as like no this should be like a five or 10e solution the people that early adopted The Nest thermostat is like oh by the way we don't support this anymore it's like it's a thermostat like then they open sourced it right right they jail broke it right no I went with the um the in Brighton zwave ones and they because there's no uh bridging needed they they connect fine and they also uh they have the ability to change them right inside a home system you can change the settings on like they have a light do you want the light on when the light is on or off when the light is on so you can like program little things to it um I think you can program a couple other things on there I thought was kind of cool but the EMB brighten ones are um one of the things I liked about them they offer a higher amperage switch than some of the other ones uh I have a couple spots because we are I have it controlling my outside lights I'm like well there's enough lights on there outside of my house that this is more than this is a bigger circuit and they have a couple options for that so does Honeywell honeywell's in a Z-Wave game with some uh higher amperage ones as well which I like to see a name brand one like that's kind of cool zwave and no Hub needed tied right into my home assistant yeah honey well needs to hire an open source Zar because Honeywell could take over the market they've got the hardware engineering and they've got the the longevity and their their headspace is right but whoever is running their software stuff has not it's just it's disappointing it really is because they could they could be doing some amazing Innovative things and it probably would pad their bottom line significantly given the Wasteland of other devices that exist because you know and this is the part that always puzzled me when companies don't just give in like cool we're a harder manufacturer we could we could actually make more money by stopping the software pushing it towards home assistant and be like the home like home assistant hey guys you guys are doing a great job keep making that great software we're just going to make Hardware because that's where our margin is uh and kind of work like have home insistent list like have something if it wants to tie to the the usual stuff but I think you're right there there's a lot of companies that could really seize the moment and say this home assistant things got some traction yeah it does and one thing I thought I think is kind of strange about that I I I could see home assistant becoming like a standard but I'm surprised it isn't by now I feel like it will be and it kind of already is in a way but it's like Android came out and henset manufacturers realized they don't have to design an operating system well they have to tweak it obviously but they they have a starting point already made and it it kind of took off well kind of took off it really took off Android's huge and it's in everything and home assist can you know be pre-installed on devices and things like that in the same way but and it is happening it's just not as much as I thought it would be by now but I could totally see it becoming the Android for home for home automation essentially that would be kind of need I like that in concept I think I think what's going to happen is like home assist is probably going to take over the universe the way that Linux took over the universe basically everywhere but desktop and it's like it's Android well it's Linux under the hood but it took a billion dollar company putting a $5 million UI on it at first to make it like oh this is now palatable and acceptable and so somebody 100% true y probably gonna do that well people hate change which is you know you know just kind of getting off my year the Linux desktop will never happen soap box it's like people in my mind they're like well based on this statistic in this statistic it's not working on the dtop no no no no people hate change an opportunity because you're not you're not taking down the current dominant company that's doing home assist home assist is something still right definitely for us nerds but definitely outside the Nerds there's not that many people like my neighbors maybe they have a couple light switches tied to it because it's simple and they like Tech a little bit but it's not the average mainstream so it's still Greenfield out there to actually build this I think there's a there's there's totally a cottage industry of like if you want to be a home alarm installer you know it's like oh this is the home alarm installer for whatever it totally could be a cottage industry to just be like oh this is the home assistant installer for blah blah blah for high-end homes or or whatever and you just have an llm you talk to and it's just like you know hello house I would like to listen to music and it's like okay let's do that and then it just you know does it and follows you around and it's not Cloud connected there's no privacy it doesn't remember things it doesn't have a concept of rock paper scissors so you know you know it's reasonably safe it's not g to try to kill you in your sleep he doesn't know why it would do it yeah yeah exactly exactly so um that but also like at the low end for home lab um I've been really impressed that tail scale hasn't gone evil like tail scale has been really amazing yeah and so it's like I want to run my own self-hosted documents and my whole own self-hosted thing and it's like great let's encrypt with the domain level authorization so you can get SSL certificates behind a firewall and tailcap and done it's like you can run your own like why not um I'm I'm shocked I there's people in the waiting though because I've I've been in contact and talking to the developers over at netb bird and they basically copied everything tailes scale does but they give you a ability to self-host a control plane but it's one of those things like it's going to be hard because tail scales undeniably that they' have been a good company I mean they even took the time to contribute code to head scale because they care like I I've always been kind of impressed by that with them and uh but you know from an ease of use I recommend it to Homeland people all the time I'm like here do this tail scale problem solved yep yeah tail scale is awesome I I feel like I'd use it more if I left the house you know because it's like I I'm just G to bridge things internally but for a bridging something to a cloud instance is um pretty cool but one thing I want to plug before I forget because we're talking about you know being in control of things and hosting things uh why you want to host or maintain your own system um if you don't know why watch um episode or season 11 episode 7 of the X Files if you watch that episode you will absolutely understand fully by the end of that episode why you have to be in control of your iot and all the things because I guarantee you um that's a conclusion everyone will come to watching that episode it's like the best example of of this it all starts because they didn't leave a tip on their meal um with the automated uh meal delivery thing at the beginning and then cha ensues from there on it's fun yeah or look at the wisecam incident yesterday so oh that's simpler yeah yeah but any xiles episode seven just throwing it out there yeah but um yeah tail scale I back to the subject anyway tail scale I would uh I'm gonna probably sit down and and work with that a lot more because I feel like you know bridging a VPS to the local network is a great use case for that I think that's probably what I'll start with yeah I think um it's very freeing that knowing that you can confidently run like next cloud and you can be a little LAX with the security updates yeah you don't have to be cutting edge because it's all behind there and the the where Sal scills Advantage right now is and granted I'll thank you for netb bird for being doing this they took the time to publish on Google and Apple so you have device level stuff which is good that's those are the only ways like that is the minimum bar right now because tail scale said it like you have to have a really good free plan you have to have integration with all the devices that people use in U that is sometimes the challenge with some of these companies especially the open source ones is actually going through the trouble of getting something publish in app stores right yeah yeah well there's head scale but then with head scale it's like it's exactly the problem it's like you can't use head skill because there's no published apps unless you DIY and S side load it yourself it's like okay yeah um fun thing though then this is where back to saying tail scale is not evil I thought this was so nice to them they you used to not be able to change on the App Store what if you downloaded directly from the App Store not s loaded you couldn't change where the uh headend server was they added an option they had an update where they added it and the only reason to do this was to allow competitors I mean that is like they did something that's against themselves so to speak that let you switch what server so you can host it because they don't offer a self-hosted option at all but head scale is the only other option you have so they actually if I think you got to do there's instructions that has has something like you got to tap it five times in the spot and then it brings up a menu but the fact that that exists and they documented it means they're you know that's a cool feature yeah tail scale is more the whole model I told Tom this I don't know if I ever said this on air but back when I first started and I knew absolutely nothing uh this whole networking model that we have now with tail scale zero tier uh it's like how I thought networking would work when I did not know how networking works I thought oh it's probably just a piece of software everyone installs and they just talk to each other and then yeah that wasn't I mean yes that's the tcpip layers underneath but it's just like it's disrupting wide area networks we don't even need like like an AT&T line like we had you know 20 years ago between buildings that cost like a 1500 a month just or even you know that's for a slow connection and now we have things like tail scale like we could basically create a wide area network in our basement with for nothing just in incredible to me that we have that ability to do that now yeah I I'd always read the promise of like certificate based authentication as you know like when I first read the IP IPC specification I was like oh this is going to be great because you can get ubiquity this will be like SSL but you have a different mechanism for sharing the Sears and like you can have this kind of secure functionality on the internet and that's not what that's not what it ended up being at all so it's like yeah is uh didn't didn't really work out that way but we're getting there now well you know Hamachi started a lot of this the original Hamachi Network that we all used and they oh right that they were the first ones to do this uh and oddly they used to use a public IP space at the time it was I mean it was technically public IP to the RFC but it wasn't in use so they get away with it for a while but yeah yeah yeah that's absolutely the case so I'm trying to think I what else is on the anything else uh that you know is on the radar coming out or even anything on your channel that we should look out for that that you're about to review other than obviously what you just uh told us about a little Nvidia box little invid box I'm gonna go to GTC and so and take a look at the stuff that's going on there because there's some there's some you know everybody's everybody's hot for AI and everything's taking over the world but for me for the home lab what I see AI is doing is giving people more agency and and control over stuff like we're in this weird limbo where everything is kind of consumer hostile because every everybody wants everything to be a subscription right you know it's like right line must go up line must go up we insist on line going up up and to the right yeah yeah and it's never it's like I want to DIY something you've never it's like okay the large language model is going to help you change out your dishwasher or the large language model is g to help you you know refinish your deck or the large language model is going to help you do whatever you would normally you know hire somebody else to do it's going to be transformational for the economy at both the microscopic and macroscopic scale but it's also going to create a lot of business opportunities and it's also going to create like it's going to make the internet unusable probably because the same incentives that exist now for blog spam it's like I'm G to write a tutorial on like how to do this thing it's like I'm just going to go to a large language model and be like write me a tutorial for this and I'm going to copy paste it to the web and then Google's going to come along and be like oh this looks like a reasonable tutorial for doing this and I'm going to rank it really highly and then just everything becomes unusably bad yeah and that's unfortunately um 404 media just did an article on this about how bad it's getting and they called Google out and it's kind of been a fun back and forth that Google was fighting with them on Twitter and they're like where journalists we're just pointing out the fact that the worst articles are now popping up to the top that are clearly written by undoubtedly some garbage language model that just keyword stuff this way you know it's the old way of doing it was keyword stuffing but essentially massage this to look like an article that should be above other articles that just shouldn't and uh Kyle Hill did a really good video a deep dive on the problem with these autogenerated video systems uh that are doing it I don't think uh were being done any favors with the latest open AI uh release of Seymour what is it called the the new video generative thing that open AI just released oh yeah yeah Kora or something Samora or something like that it's got some weird names yeah um so okay yes I agree with you but if if you pull this thread out like don't don't look at it down here step back and look at the the the we the three of us have a unique opportunity that we didn't have before you see Google being in the middle of distribution and search and everything else and then being able to sell ads based on that they they held all the cards so like if I wanted to run an ad or advertise something on my website and my rates were you know $5,000 an ad Google could observe someone going to my website and then going to Grandma's cookie blog and Grandma was willing to run ads for $100 and so Google could say okay I can get that ad for those for that cohort in front of who you want for a hundred bucks and uh not $5,000 and so Google could make a bunch of money on that with AI and everything being a trash fire in terms of content we have the power again as Publishers like if we create content or if we are known or if it's just like yes this was blessed by the three of us or the five of us or the 10 of us or whatever in our cohort then that is suddenly more valuable again and we don't need middleman to sell that and we don't need we we just like with the hom assist and stuff is like it's a genuinely good product the reason I like it is because it is less human suffering for the people that use it as compared with say a nest thermostat or the Alexa smart assistant like the hardware in Alexa I happen to know one of the guys that works on that Alexa Hardware the hardware there is incredible there is unbelievable engineering and computer science that is in signal to noise like it's just insane but the hardware is it's like I would like to run this and connect it to my local thing and maybe there's some benefit for Amazon there like will I'm willing to spend 200 bucks on the hardware because it's that good uh no no you can't you can't unlock it you can't do any of that and so there is this huge SE change where we are going to seize control of the publishing and take over all of this stuff and so when you look at it microscopically this the shift can only be that content from published from people that you get to know is the trusted content there's no alternative there's no endgame I I agree with that and and it's frustrating for me I run into the same thing with you know Tech articles or after work is over gaming articles where they're obviously written by Ai and it it they just drag on and on and on it's like I'm trying to figure out how to beat quest number 45 and then I look it up and it's like why Quest 45 is important the history of the design of this Quest the person who thought it was a good idea the company behind the game the birthday of the second in command of the company followed by at the very end the thing that you actually went there to look for and it's so obvious like you read the that it's so robotical that it was just people realize we could just flood articles out there and that worries me a bit but I feel better knowing because I agree I think you you need to have that Persona like a person around the content whether it's a blog post or it's a a video that you're getting information from a person who has took their time to vet the information just like you were saying and um that that makes me feel a little bit better because I I do feel that we once you lose that human factor completely then it it becomes invalidated in my opinion you remember the old days of the internet when you had page Rank and people were buying domains and then it was it was like you know this domain is turned into something else we're we're going to go back to that like the the response from Google the Band-Aid from Google is to just look at their history of all the domains and be like crap and then okay Tom's Hardware and this and this and this historically those were good and so they're going to get a huge boost um and all of the new sites and all the new players they're going to be locked out which is really kind of sucks but for us I feel like we would take people under our wing and into our community and be like yes so and so has written an amazing guide on blah blah blah and you should check it out because it's actually legit so we will be able to combat some of that but Google's response to this can only be to retroactively increase the value of stuff so it's like I'm gonna be getting game guyses from Kotaku again what this doesn't even make sense what world is they've already pivoted away from that kind of content I'm still mad about joystick shutting down so many years ago but that's just me that's such a great sight site but but yeah I think that you know everyone just we watch Sci-Fi even people that aren't into Tech and then we think that going to have um Ultron or something out of this and then you know it's just going to be a really bad situation but I just feel like it's more of a um query and response system than anything else you know you give it a query it returns something to you and it's kind of like um extending our capabilities as humans like maybe it's just going to cut down time to program a home lab because you can just explain how you want it done and obviously there's going to be issues you can go back in and fix but get things done a lot quicker than we could by ourselves by extending our capabilities even further I think that's a great thing yeah well I want say too I I kind of took a queue from you wendle a number of years ago when I was like looking at forums I use the same Forum software you do use discourse right you're stilling that yeah um and that's one reason I created my own forums so I could host it myself manage it myself be the one in control and now five years after running them I had to move servers because the load got really high and uh that's exactly the result I wanted um I was actually looking I get about 50,000 unique visitors a week and six million hits across there I know yours is substantially bigger than mine a lot of fun but see that but it's also content so like a lot of our community also is like hey we want to do Discord let's do Discord and there's a lot of Enthusiast communities that are in Discord because it's like instant response like you can get a thing you can get instant response but that's terrible for knowledge capture it is and that's one of the reasons I I've doubled down on this I've seen a few other um epos Fox had made a couple rant about it going quit sticking all your data and discourse like it's not the place to put it put it on a public forum where others can without signing up just research and find it if people want to sign up and participate they can you create the watering hole of good information like there's cruff all around us uh let that AI stuff do it if you know you go to level one Tech forums Wendell has really good writeups on any of the things that you reference which I think is important there's some of the cues I took as a Creator going how I like what Wendell does he talks about this project he talks about the code for this you know detailed step byep is all in the forums perfect other people can participate and iterate on it as well once they become participants and I think it's a beautiful thing it's it's not just that I mean it's any more like it is mind-blowing so we've got the launch of like the new thread Ripper 7000 series stuff and the thread Ripper 7000 series stuff had like there are so many like over $10,000 builds in our Forum it's like good Lord this is crazy this is but it's Lessons Learned and shared stuff there's lots of weird things like if you want to use suspend like S3 suspend a lot of power supplies don't actually have enough suspend standby power to keep h panels of ddr5 registered ECC memory powered well that's an interesting problem that I didn't think about yeah and so like we actually have one guy who uh destroyed his power supply only the 5volt standby current and so everything kind of still works but it won't post so like you turn it off it's a real hard time a ballpoint pen trick to turn it on then or yeah yeah well and then you got to clear the seos and then bringing it up and it's just like Oh and it turns out it's because the power supply standby current was insufficient it nothing to do even with S3 suspend it was just like their their power supply could only handle like an amp or two of standby current and you need like three amps and it's like well if you're getting you know if you're spending three or four thousand on a get like a 1,200 watt power supply that's brand new like big question it's 2024 why does suspend and hibernate still suck and I'm looking at every operating system here yes Linux has issues I know but I've had problems with suspend on every op operating system and how why is it in 2024 I can't like shut my computer off you know like hibernate style turn it on and boom my stuff is there and it's ready to go um I mean we started working on this and then when you go into the trenches of Linux and you look at like um I like suspend then hibernate it's my one of my favorite ways of doing it it suspends but if you let it let it suspend for too long it wakes up and then it hibernates itself so it can retain its battery it's really cool and the Linux kernel supports this but they kind of just stopped and it's in limbo and it's not default anywhere we at least with gddr or D at least with registered ddr5 so when when the when the industry is bringing up registered ddr5 or ddr5 it's registered servers first it's always servers first right and then they try to get it working in the context of desktop and mobile and everything else and so things things change but uh in in desktop they never figured that servers would ever want to do S3 suspend so like s suspend in the context of like a Server Motherboard has basically never worked oh right right that does make a lot of sense too because sometimes I think about the wasted power if a you know company's only operating 8 to five I don't know they don't even have a website maybe they're just a local store or something um well they still need a website but the point is if you have a server that you're not using 247 and it's not a 247 operation turn it off like gu no one's even signing in um if they can suspend that saves a lot of power but if everybody thought about that the power grid savings would be massive worldwide if if you know just the small percentage of companies that don't need a 247 operation just turn their servers off but then suspend I could see why that'd be hard on servers but I could also see a benefit there too if it could just get it to be reliable I really want to start a blog about all the things that are terrible with all of the different operating systems in like a funny and humorous way like I don't know how to I need like just a punchline kind of thing like like a oneliner and there's so many there's so many and it's hard for me to think of them off the top of my head but like okay on Windows when the F when the system first wakes up this is why I thought of it you have to like swipe the screen or do something like if I can't just hit enter wake the machine and then type my password that is so yeah I thought about making a video one one time and I I think I'll never do this because of the YouTube algorithm will make sure nobody ever sees it if it's not directly Linux related but I just thought about like like it just reminded me because I thought about all the annoying things that we deal with that we never talk talk about that are just small little problems like we copy P we copy text it doesn't paste we copy it again it works we move on but why didn't it work the first time when you know you hit the copy button or you're using your mouse and you run it into your coffee mug and click something you didn't mean to click or you know all these little tiny things that we deal with using computers day human interaction with digital is hard too many people anxiety I think yeah yeah because the computers do that anyway but then we also can't figure out so spend so yeah yeah I like the idea of you open the thing and it's on like that should be like less than a one second operation that's how it was in the dawn of like I want to give people ancient machines like I want to give the engineers and the software people working on this like here's an hp200 LX from 1993 the suspend resume experience should be identical on Modern Hardware the input latency should be identical on Modern you hit on it's on you hit off it's asleep and if it needs to wake itself up and then go to like deep sleep later that's cool just hide it from the user like how hard is this come on why are we still rebooting operating systems anymore yeah yeah you know why why do we need to reboot a server or your desktop laptop nowadays um I never would have thought we'd still be doing that but here we are but I also never thought we'd be using mice but we're still using mice so I really want somebody to put an llm into a desktop organization thing because I find myself like when I need to switch gears mentally I want to switch gears quickly and workspaces is kind of useful for this but I also want to save and restore the entire state of the workspace including browser tabs and so it's just like I can't work on this anymore I need to save the state of this and my gosh if I could move that state between a mobile machine and a computer or like the computer at this desk and the computer at another desk and the computer somewhere else and I could just be like and then all of my stuff would go to the other machine I would be so happy you brought brought up tabs and I it's a it's a pet peeve of mine and I don't think very many people will share this but it'll be kind of funny if it ends up being a thing where it's called Tab sync but it isn't okay I think of sync as you know like sync thing I save a file on my desktop and it appears on my laptop and I edit it on one and then it sync to the other that's syncing okay being able to go into your history and then query the tabs that were last opened the last time you had your laptop open last Tuesday that's not stinking I want to open a tab in my browser and have that same tab automatically open on my other computer and when I Clos that tab on that computer I want it to automatically close on the other one I want an exact onetoone duplicated browser tab experience but nobody the closest thing we have is workspaces and browsers which is my favorite Obsession in browsers but we don't have true Tab sync and I wish they'd stop calling it Tab sync it's not so I I have this for certain projects that I work on like one or two days a month and my solution for this has been a VM with Hardware accelerated Graphics running on a server that I RDP into and it's it's usually the RDP protocol on Linux because the RDP protocol on Linux with Hardware acceleration which requires patches and jumping through and a lot of headache is an amazing and fast experience whereas the RDP experience out of the box is horrible and awful and no one like no one understands what problem they're trying to solve with the RDP with the whole like oh it's a local login oh it's not a local login it's a remote log like no one understands right and the only thing that I think makes that a problem at least when I try it is watching a YouTube video that's that's going to be the thing that is going to have to be on my local computer because at least for me I've never had that work that's not the best experience if you do the hardware h264 acceleration it is seamless and it is low latency and like once you experience Hardware accelerated RDP you don't go back yeah you're not gonna go back it's it's and it's just like oh I had no idea yeah and so like if you want to save the state of your like how I'm saving the state of my workspace is literally the entire machine and so it's just like oh I had a bunch of tabs open that were research or I was looking at an academic Pap paper on like RXV or whatever and it's there it's still there and I trust that it's there and I trust that an update or something isn't going to wreck it it's all it's just there like it's there on that machine and it's easier for me to just log into the entire machine and the state of the machine is there yeah someone brought up uh Vivaldi and I I I'll you know touch on that real quick have you guys used the the newer style workspaces in any browser so far no it's so transformative like like Firefox doesn't have it but you know other browsers do like Opera Baldi they have it I think Chrome has it but I don't know I don't use Chrome often but imagine workspaces in your browser like you have workspaces on your desktop so I have a workspace for example system administration so I click on it and then my proxmox console tress console whatever is there I switch to my reading workspace and all the Articles I'm reading are there and I could switch back and forth and when I do all the tabs disappear and only the tabs that are in the other workspace appear and you could just keep switching back and forth I think Safari uh supports this as well but uh I have a bug report for a wish list in Firefox to get them to adopt this because literally everyone else is but it's the closest we come and so someone mentioned Vivaldi and I just wanted to yeah recognize that does have that workspace feature I feel like it's the closest we do have to a true Tab sync experience but workspaces and browsers just I feel like it's the new like how tabs revolutionize browsing in a way I feel like workspaces is going to be like the the next thing like that on that level if only Firefox would implement it darn it yeah I I want that not just for the brow well I mean okay if you live in the browser like if that's accelerating our browser only future where like the browser does everything which is where seems where Microsoft seems to be going with all their stuff yeah which is fine I guess but I want the whole I need I need the state of the whole desktop like my Windows mysh connection you know everything yeah I like all of that to just be like I don't it should not I've gotten to the point where I can context switch faster than the computer and that is like good point yeah the only thing that I feel like comes close to what you know we would want is like having multiple users on your computer with fast user switching and every user has different apps open you can switch back and forth but that still doesn't solve the problem of and I know we're complaining because it's like how long does it take to boot your computer I get it but at the same time you add up all these small little tiny inconsequential things and it adds to a bigger frustration so the more seamless things are the better overall things can be and I think that's why we care about these things because you know we think of it like this can be better the average person thinks of it like well that's the way it is that's the difference between people that are not techies and people that are we want it we want to see it better everyone else either complains about it they don't but they still at the end of the day the world the way it is I want there's a way I can reshape it to be but we'll probably leave it at that because we've gone on for about an hour here no this is all good topic it's I I really enjoyed this also the the screen saver thing in Gnome it's like one minute increments to 15 minutes and then off and it's like really guys come on that's still a thing why is started on gnome because gnome has so many hidden features and things in there like this is going to put people in a rabit like and I'll ask you wend I might have told you so you might know did you know that you can name your workspaces and no no I didn't know that just workspace one two three four right that's what it is now there's no visibility in the guy anywhere no settings not even in the tweak tool you will there's no such option but if you go into gcom you can go in there and you could type a string for each of the workspaces and it looks like someone started working on this and probably presumably was going to have something exposed in the in the gooey so you could change this and then I don't know they just moved on to something else but the framework is there you can name your workspaces and I use anable to name my workspaces so I could say this is my CIS admin workspace this is my email workspace and have them actually labeled as such but it's like they started and they stopped so there's so many settings in Gnome and my point is with the screen saer thing I wouldn't be surprised if you could probably adjust it down to the minute if you go through you know the settings under the hood you can yeah you can that was an assumption and I was right why was I right because I've been fighting gnome for years so yeah um yeah I'm I'm watching what system 76 is doing with Cosmic and it's just like I get why why they're working on Cosmic After experiencing the like why can't I have a 20 minutes why can't I have an hour because sometimes you know I get distracted by things and it's like I need this to stay on for an hour so that I know it's like oh that computer's on I need to finish the thing that I was doing on that computer and that's just because I'm so scattered I remember when looking forward to the whole Cosmic release this is something we haven't seen in a Linux s hopper in a while some true excitement I'm I'm here for it I've asked them like three or four times if you could please make it so you can name your workspaces on demand I would really appreciate it they said they're interested and they might do it I'm not gonna I can't speak for them but it was funny when the pap tiling came out and I remember I was there at the not when they first came up with it but when they were announcing it and it was Be You Know Carl had this ultrawide Monitor and he's running gnome and didn't like the way gnome and I don't like the way gnome is on a monitor of that size because you you split like you tile a window on the left and the right in Gnome you have like just your monitors cut in half but they started some people started using sway because you know that that worked out better then that that like let's put this in popos we're not even using our own OS we want to so they put it in there because you know they they scratched an itch as so many other things did and then next thing you know you have sway inspired tiling in Pap yeah yeah it's and that's that's the nice awesomeness of Open Source but I think if we're going to ever have the year of the Linux desktop it's going to take somebody that has this kind of a mindset to become a benevolent dictator like like lenus and it's like this is what the desktop experience is going to be and it's going to make sense and then people are going to use it and say oh this is amazing that's the that's the that's the cult of per personality that Apple has like apple like somebody inside apple is doing this kind of stuff it's like no we will obsessively get the latency on this down or we will obsess ly worry about this thing and it's like there are people like that that'll do that in the in the community but then they're also kind of hard to work with sometimes and so it's kind of like we don't ever yeah I tell people a lot like like I bring this up every now and then like you know what would it take for the year that does stop to happen it's not going to happen and you know in the way I see it I could if I could conceivably in Another Universe make a Linux Dro that is 100% compatible with every app that has ever been released I don't care if it's iOS Android Windows Linux let's say it's this the epitome of compatibility and everything runs twice as fast it's like the best thing ever no one's going to change to it why because it's change and I don't care how good it is the minute you introduce change the average person's at at work it's a work tool they come home you know they socialize they relax or whatever um they're not trying to introduce like a whole lifestyle change around their computer and the average person doesn't talk about op operating systems so as much as I'd love to see Linux take over the desktop um I feel like Linux is happy where it is it's not losing any Linux isn't losing any sleep about its inability to saturate the desktop so I think we're fine that's just my my opinion on the matter it's it's people overanalyze things it's just as soon as you introduce change unless you have a company like apple to tell you why you need this change nobody's gonna go for it well let me let me turn the conversation I don't know we're out of time but this is this maybe like homework go right ahead turn the turn the conversation on it on its side a little bit if you had an easier ability to do the kinds of customization that you want like the screen saver thing which I had to dig in and find like you apparently had had the itch for the workspaces yeah then maybe we would see more of it's like it's easier to do the app development it's easier to do the customization it's easier to do abcxyz if you look at open source office suites like open Office like the code base and the methodology and like modern like how we do software development in 2024 and how that project is structured way different if we had a desktop environment that like if we just did uh what is Joel spolsky had a word for this where you do the transformation like you don't change anything you just go and you do cleanup and and you just make it the modern process if we did that if we did a pass like that on gnome or something else like that so that you don't have to be a 17th level wizard in order to make these kinds of customizations I think that is what will lead to the year of the Linux desktop because suddenly it becomes way easier for everybody to do this llms might do that it's like asking llms like I want to customize my stuff or it's like this is weird it seems like I'm getting an extra frame of compositing what's going on and it's like oh you can do this or install this patch from the sky and it fixes it it's like oh okay and I think it's a really good point because if you have to learn the technical debt in order to make the modification like oh you can't touch the hour thing because there's a chain reaction that happens when you touch it those are the problems right once you get into kind of a modern code base you're like it's structured well it makes it a lot easier to develop on that framework yeah and giving people better tools to be able to do those kinds of customization making it EAS making the whole development tool chain a little easier is good and like having developed a couple of device drivers for the Linux kernel for obscure Hardware way back in the day um they made it really easy for developers and it's very easy to like okay this thing doesn't belong in the kernel but you need to build your own thing it's not an impossible task the way that it is for some of the other stuff so that's really cool yeah that is yeah that's uh wow lots to think about lots of homework now I love that's what I love about talking about home lab stuff it's like I always end up like that was a good idea that was a good idea and then I know what I'm doing later so starts getting on this Hardware my favorite thing about home lab and like if you organize your documents you organize your files like I had I had a media collection that I stopped using for a few years because it was like a streaming services are good enough they no longer are and guess what I've dusted off my old media collection and so it's just like yes that's what I'm guess we're having a conversation about later today yeah that's like the next thing me and Jay were we have a a two o'clock that we're doing and it's about that because in uh there's actually even since chaye invited me to that there's been like two more companies that have really screwed up um Crunchyroll I think is one of them but they're just really I didn't know about yeah I got a list and I got I got I got notes I made because it's kind of crazy all these companies that you paid for you bought the media now you have no way you couldn't download it and now the subscriptions you bought and your ability to view those are gone and it's coming at quite a question I know PlayStation uh is one of them that did this some of the media bought and it's it's kind of sad I mean we we talk about we like retro games and we talk about being one of the golden era of gaming but it's because it's the last time you can own your media games released today are so tied to these licensed servers and everything else or only work with activation with an online server or interact with that server so once that server goes away the game itself becomes useless so 20 years from now we weren't going to play those same games that we're playing in 2024 um they're not a lot of local Anda games I'm hoping to see a Resurgence in that but it's really interesting because the whole concept of media ownership like the streaming services were supposed to solve it and they didn't the lawyers and got involved the minute you introduce complexity into Leisure Time you failed I don't care if it's a game or a movie music or a TV show whatever it is you're into you listen watch whatever to unwind nobody wants to think about finances during that time they don't want to think about work during that time it's their escape but now you know they're being nickled and dimed at every single opportunity constantly having to think about the money aspect of it they don't even know if the season they're in the middle of is going to be there tomorrow for them to finish it and that's the world we live in so that's just um very unsettling but we we have we'll have a lot to say about that that is that is a side mission for all of our audiences and all of our content is we we probably should put more of an effort into organizing our audiences around getting our Congress creators to enshrine in law the first sale Doctrine as it exists for books for digital media great idea yeah I mean yeah the the way I look at it if I buy a Blu-Ray from the store it's up to me to keep it safe if I step on it my fault if I lose it my fault it's my responsibility but when someone else is holding on to my media for me I I just like you were saying I want to see better stewardship of this you know I want to see respons ability here because I'm not trying to lose an investment I want the right to format shift the media enshrined in law period yes absolutely agree yep Absol AB one day we'll have it I actually feel positive about the future it's it's up to it's only will only we will only have it one day if we mobilize our audiences and demand it because otherwise we're just going to be we're going to continue to be the slow boiling frogs that we are and we we've already seen the future we're living it yeah we're living it ensive to me when so when Sony announced what they announced and this last thing I'll say about it I'll get get off my Soap Box um obviously in the end user license agreement they had the right to do this blah blah blah but I still think there should have been a bigger outcry from people people should have been everyone should have been screaming it's like people were too complacent about losing their investment it it sure it was all over the news but it was not that big it was just kind of a barely a blip in Sony's um controversy history yeah and that's surprising to me because I I feel like everyone should just make sure they understand that that this isn't acceptable but as long as we let them do it they're going to keep doing it so that was that was true with books as well like when they before the first sale Doctrine it was just they got away with a lot in terms of like well you agreed not to resell this book when you bought it and we're the only place you can buy the book so you have to agree to it there's a lot of that same sort of we're going to hold you hostage with all of this you have no choice like what are you going to do not use Amazon what are you going to do not use Google and then the hilarious well not hilarious but you know kind of hilarious story it's ironic and it's hilarity 1984 being taken off of everybody's um you know Kindle a long time ago which was like the the the worst possible book that you could take off of people's devices yeah a do and I I do like I think he refers it to as not just the inch ification cycle but also felony contemp of business model well you you were treated in a very poor way he's um his his last couple books uh about that sees the means of computation great book along with his chokepoint capitalism he talks tons about media ownership rights I read both of them and it's just your head's spinning when you're like God these companies are bad yeah they will literally do what they're allowed to do under the law as amoral and yeah and they are determined to rate worse laws continuously yeah yeah like it's it's not sustainable like we we have like the fact that we have large language models that will enable the individual to have agency like they have never had before which is incredible and so it's like let's put it to work how long until we tell something like a a language model to create a TV series centered around this kind of character with this kind of storyline in this setting and then next thing you know we're just watching it and but it regurgitates it's not original it regurgitates I can wish years there was a joke that I made when I first appeared on the internet which is the the at the rate we're going we're going to be able to just say all right take Peter Jackson's Lord of the Rings replace all the characters with Danny DeVito or Nicholas Cage and you know let me see and that's you can you we so close to that so close breathtakingly close to that so I don't have to syn the dark side of the moon to Wizard of Oz manually anymore somebody did uh Danny Devo from Always Sunny in Boulders Gate 3 and it was just it's amazing it's just incredible that sounds great my favorite one so far was was uh the Cable Guy in cyberpunk nice yeah that was the best ah this is great all right once again wend thank you so much for day was great pleasure we'll see you around and uh thanks than everyone see you