Search Minetest mods!

User avatar
Krock
Member
 
Posts: 3598
Joined: Thu Oct 03, 2013 07:48
GitHub: SmallJoker

Search Minetest mods!

by Krock » Thu Sep 18, 2014 17:09

Mod Search engine
Image

Why?
It's a pain to search mods on this forum, therefore I added a fast way to get a topic link for a specific mod.
Also, it allows to filter the results or to look up all mods by an user.

Special
You can search for two mods at once by separating the keywords with a "|". (shown as in the image)
Also, there's a simple feedback system (Like / Dislike) which requires JavaScript.

Link: http://krock-works.16mb.com/MTstuff/modSearch.php

Suggestions and bug reports are appreciated.
Last edited by Krock on Mon Feb 29, 2016 17:17, edited 2 times in total.
Newest Win32 builds - Find a mod - All my mods
ALL YOUR DONATION ARE BELONG TO PARAMAT (Please support him and Minetest)
New DuckDuckGo !bang: !mtmod <keyword here>
 

Sokomine
Member
 
Posts: 2980
Joined: Sun Sep 09, 2012 17:31

Re: Search Minetest mods!

by Sokomine » Thu Sep 18, 2014 17:16

That's a very good thing! It ought to be linked somewhere. Else this mod will get lost like all the other ones.

Do you execute a live search or do you parse the forum pages from time to time?
A list of my mods can be found here.
 

User avatar
Krock
Member
 
Posts: 3598
Joined: Thu Oct 03, 2013 07:48
GitHub: SmallJoker

Re: Search Minetest mods!

by Krock » Thu Sep 18, 2014 17:29

Sokomine wrote:That's a very good thing! It ought to be linked somewhere. Else this mod will get lost like all the other ones.

Do you execute a live search or do you parse the forum pages from time to time?

Good question. I wrote a bot to do this job, using an open source html parser library and some MySQL queries to add and/or update the mods.
I will run it sometimes a week for the 1st and 2nd page of Mod Releases and Modding General - maybe once a month for a complete update.

It will not have a DDoS effect because it only reads from the forum pages and not from every single topic.
Newest Win32 builds - Find a mod - All my mods
ALL YOUR DONATION ARE BELONG TO PARAMAT (Please support him and Minetest)
New DuckDuckGo !bang: !mtmod <keyword here>
 

User avatar
Minetestforfun
Member
 
Posts: 936
Joined: Tue Aug 05, 2014 14:09
GitHub: Darcidride
IRC: Darcidride + MinetestForFun
In-game: Darcidride + MinetestForFun

Re: Search Minetest mods!

by Minetestforfun » Thu Sep 18, 2014 17:30

Good work ! :)
 

Sokomine
Member
 
Posts: 2980
Joined: Sun Sep 09, 2012 17:31

Re: Search Minetest mods!

by Sokomine » Thu Sep 18, 2014 18:04

Krock wrote:Good question. I wrote a bot to do this job, using an open source html parser library and some MySQL queries to add and/or update the mods.

That's good. I've tried to sort mods into categories on the Wiki, but doing so manually was so much work (tedious cut&paste) that I gave up. With a script that parses the forum automaticly, introducing categories becomes far more doable.
A list of my mods can be found here.
 

User avatar
webdesigner97
Member
 
Posts: 1307
Joined: Mon Jul 30, 2012 19:16
GitHub: webD97
IRC: webdesigner97
In-game: webdesigner97

Re: Search Minetest mods!

by webdesigner97 » Sat Sep 20, 2014 14:42

+1 for PHP-friends!
 

User avatar
rubenwardy
Member
 
Posts: 4500
Joined: Tue Jun 12, 2012 18:11
GitHub: rubenwardy
IRC: rubenwardy
In-game: rubenwardy

Re: Search Minetest mods!

by rubenwardy » Sat Sep 20, 2014 15:39

I used to use php a lot, and now I have resolved to never use it again.
 

User avatar
Evergreen
Member
 
Posts: 2131
Joined: Sun Jan 06, 2013 01:22
GitHub: 4Evergreen4
IRC: EvergreenTree
In-game: Evergreen

Re: Search Minetest mods!

by Evergreen » Sat Sep 20, 2014 20:26

rubenwardy wrote:I used to use php a lot, and now I have resolved to never use it again.

Why not?
"Help! I searched for a mod but I couldn't find it!"
http://krock-works.16mb.com/MTstuff/modSearch.php
 

User avatar
rubenwardy
Member
 
Posts: 4500
Joined: Tue Jun 12, 2012 18:11
GitHub: rubenwardy
IRC: rubenwardy
In-game: rubenwardy

Re: Search Minetest mods!

by rubenwardy » Sat Sep 20, 2014 22:03

It is a terrible language with lots of inconsistencies. Badly designed. There a lot of better frameworks that are faster to develop for and the result is less messy. Django (python) and Rails (ruby) being examples.
 

User avatar
philipbenr
Member
 
Posts: 1665
Joined: Fri Jun 14, 2013 01:56
GitHub: philipbenr
IRC: philipbenr
In-game: WisdomFire or philipbenr

Re: Search Minetest mods!

by philipbenr » Sun Sep 21, 2014 00:51

Yes for python. Very good language.
 

User avatar
srifqi
Member
 
Posts: 508
Joined: Sat Jun 28, 2014 04:31
GitHub: srifqi
IRC: srifqi
In-game: srifqi

Re: Search Minetest mods!

by srifqi » Sun Sep 21, 2014 04:41

+1
I'm from Indonesia! Saya dari Indonesia!
Terjemahkan Minetest!
Mods by me. Modifikasi oleh saya.

Pronounce my nick as in: es-rifqi (IPA: /es rifˈki/)
 

User avatar
balthazariv
Member
 
Posts: 214
Joined: Mon Apr 07, 2014 15:48

Re: Search Minetest mods!

by balthazariv » Sun Sep 21, 2014 17:08

Very good, i like it.
 

User avatar
Krock
Member
 
Posts: 3598
Joined: Thu Oct 03, 2013 07:48
GitHub: SmallJoker

Re: Search Minetest mods!

by Krock » Thu Oct 02, 2014 19:38

Update!
- Added AND and OR support in the keywords

How it works: (creative mode = true)
Image
Newest Win32 builds - Find a mod - All my mods
ALL YOUR DONATION ARE BELONG TO PARAMAT (Please support him and Minetest)
New DuckDuckGo !bang: !mtmod <keyword here>
 

User avatar
ExeterDad
Member
 
Posts: 1121
Joined: Sun Jun 01, 2014 20:00
In-game: ExeterDad

Re: Search Minetest mods!

by ExeterDad » Fri Oct 03, 2014 02:57

I think a list of indexed mods would be a useful addition to your page. Nice work BTW
٩(̾●̮̮̃̾•̃̾)۶

Kibbie and I have a beautiful public server now! HOMETOWN
 

User avatar
Krock
Member
 
Posts: 3598
Joined: Thu Oct 03, 2013 07:48
GitHub: SmallJoker

Search Minetest mods!

by Krock » Sun Oct 05, 2014 08:33

Update!
- Bugfixes
- New keyword marker

Image
Any suggestions?
Newest Win32 builds - Find a mod - All my mods
ALL YOUR DONATION ARE BELONG TO PARAMAT (Please support him and Minetest)
New DuckDuckGo !bang: !mtmod <keyword here>
 

User avatar
Casimir
Member
 
Posts: 1101
Joined: Fri Aug 03, 2012 16:59

Re: Search Minetest mods!

by Casimir » Sun Oct 05, 2014 11:19

I don't even try to use the forum search anymore. It should be on minetest.net

One bug: When you select Author and then go to the next page, it switches back to Title.
 

User avatar
Krock
Member
 
Posts: 3598
Joined: Thu Oct 03, 2013 07:48
GitHub: SmallJoker

Re: Search Minetest mods!

by Krock » Sun Oct 05, 2014 16:34

Casimir wrote:One bug: When you select Author and then go to the next page, it switches back to Title.

Thanks for reporting. A small typo caused this fail - Fixed.
Newest Win32 builds - Find a mod - All my mods
ALL YOUR DONATION ARE BELONG TO PARAMAT (Please support him and Minetest)
New DuckDuckGo !bang: !mtmod <keyword here>
 

Sokomine
Member
 
Posts: 2980
Joined: Sun Sep 09, 2012 17:31

Re: Search Minetest mods!

by Sokomine » Mon Oct 06, 2014 02:36

It would be great to add a link to this in the forum at a prominent place so that players do get a chance to find mods.
A list of my mods can be found here.
 

Sol
Member
 
Posts: 73
Joined: Thu Jul 31, 2014 05:21
In-game: sol

Re: Search Minetest mods!

by Sol » Mon Oct 06, 2014 04:46

Suggestion: don't make tiny annotations like this, it's very hard to read.
http://i.imgur.com/AMTBgP9.png
There is no such thing as duty. If you know that a thing is right, you want to do it. If you don't want to do it—it isn't right. If it's right and you don't want to do it—you don't know what right is and you're not a man. -- Ayn Rand
 

User avatar
Krock
Member
 
Posts: 3598
Joined: Thu Oct 03, 2013 07:48
GitHub: SmallJoker

Re: Search Minetest mods!

by Krock » Thu Jan 15, 2015 18:26

Update!
- Added games to the page
- Added a filter for games

Image
Newest Win32 builds - Find a mod - All my mods
ALL YOUR DONATION ARE BELONG TO PARAMAT (Please support him and Minetest)
New DuckDuckGo !bang: !mtmod <keyword here>
 

User avatar
lightonflux
Member
 
Posts: 384
Joined: Mon Nov 11, 2013 07:22
In-game: lof

Re: Search Minetest mods!

by lightonflux » Thu Jan 15, 2015 20:44

Can you add a "Minetest" to the <title> of the page? It makes it easier to find the bookmark in your browser. "Mod search" is not as great as "Minetest Mod Search" if you do a search for Minetest in your bookmarks. :)
 

dgm5555
Member
 
Posts: 244
Joined: Tue Apr 08, 2014 19:45

Re: Search Minetest mods!

by dgm5555 » Sat Feb 14, 2015 13:49

I just suggested a button for the Python gitsync tool could very easily be added to the lua forming the front page of minetest https://forum.minetest.net/viewtopic.php?f=14&t=8749 and wrote a scraper to extract all the git links from the forum and now find this.
Would it be posible to merge this with gitsync and add user voted tags for sorting. You'd have a far better 'modstore' then...
If not could you also use your search to produce a list of links to save from multiple scrapers working...

PS Also could one of the admin create a pinned post on the forum you could just keep updated with your list?

PPS could you also do the same for worlds/maps?
 

User avatar
Krock
Member
 
Posts: 3598
Joined: Thu Oct 03, 2013 07:48
GitHub: SmallJoker

Re: Search Minetest mods!

by Krock » Sat Feb 14, 2015 18:51

Well, I only index forum topics. I don't extract download links from every post.
I don't see how this could be merged with gitsync since the search engine uses PHP, MySQL and a handcrafted update script which has remote access to the MySQL database. Adding tags is a good idea but I must be aware of intentional spammers.
dgm5555 wrote:[..] list of links to save from multiple scrapers [..]

Could you please explain what you mean with this?

I could extend my program/script to fetch the data of a list if there are enough informations.
Yes, I could do the same for worlds and maps but there it's a bit complicated to ignore talk-only topics.
Newest Win32 builds - Find a mod - All my mods
ALL YOUR DONATION ARE BELONG TO PARAMAT (Please support him and Minetest)
New DuckDuckGo !bang: !mtmod <keyword here>
 

User avatar
maikerumine
Member
 
Posts: 946
Joined: Mon Aug 04, 2014 14:27
GitHub: maikerumine
In-game: maikerumine

Re: Search Minetest mods!

by maikerumine » Sat Feb 14, 2015 20:36

This is a great addition! thank you for making this!! Now we need to get all the modders to have a similar name convention and post in this forum!
 

dgm5555
Member
 
Posts: 244
Joined: Tue Apr 08, 2014 19:45

Re: Search Minetest mods!

by dgm5555 » Sat Feb 14, 2015 21:26

dgm5555 wrote:[..] list of links to save from multiple scrapers [..]

I meant I have just run a python bot/scraper over the forum and extracted html links which point to git addresses ('list of links'). However if you're also doing (albeit for a slightly different purpose) the same it doubles the server load (thus the reference to 'multiple scrapers'). Combining this function into your tool would be much friendlier on the forum (and yours sounds better than mine as I searched every post in the forum).
Here's what my list looks like: https://forum.minetest.net/viewtopic.php?p=170199#p170199
 

User avatar
rubenwardy
Member
 
Posts: 4500
Joined: Tue Jun 12, 2012 18:11
GitHub: rubenwardy
IRC: rubenwardy
In-game: rubenwardy

Re: Search Minetest mods!

by rubenwardy » Sat Feb 14, 2015 22:30

The mod store is at http://forum.minetest.net/mmdb but it is currently broken due to issues with the forum.minetest.net database. The main develeper, iqualfragile, will do it soon now he knows what the problem is. (The problem doesn't affect viewing, only the adding or editing or commenting.)

It would be very useful to have a bot to extract the mod name, title, licence, description, GitHub or repo and download from the forum.
 

User avatar
Krock
Member
 
Posts: 3598
Joined: Thu Oct 03, 2013 07:48
GitHub: SmallJoker

Re: Search Minetest mods!

by Krock » Sun Feb 15, 2015 10:05

Experimental function added: (Only available for mods in the forum "Mod Releases")

Image
Newest Win32 builds - Find a mod - All my mods
ALL YOUR DONATION ARE BELONG TO PARAMAT (Please support him and Minetest)
New DuckDuckGo !bang: !mtmod <keyword here>
 

User avatar
Krock
Member
 
Posts: 3598
Joined: Thu Oct 03, 2013 07:48
GitHub: SmallJoker

Re: Search Minetest mods!

by Krock » Tue Feb 17, 2015 18:59

http://irc.minetest.ru/minetest/2015-02-16#i_4157203

This is not a proper JSON file but bots should be able to read it.
If wanted, I can include a "view source" and "download" link if available.
Image
Newest Win32 builds - Find a mod - All my mods
ALL YOUR DONATION ARE BELONG TO PARAMAT (Please support him and Minetest)
New DuckDuckGo !bang: !mtmod <keyword here>
 

User avatar
Napiophelios
Member
 
Posts: 752
Joined: Mon Jul 07, 2014 01:14
GitHub: Napiophelios
IRC: Nappi
In-game: Nappi

Re: Search Minetest mods!

by Napiophelios » Thu Mar 19, 2015 01:32

If you search "Random" with a blank search feild you get this:

Your phone or window isn't wide enough to display the code box. If it's a phone, try rotating it to landscape mode.
Code: Select all
Fatal error: Call to undefined function connect() in /var/customers/webs/nimg/MTstuff/modSearch.php on line 78 Call Stack: 0.0008 308720 1. {main}() /var/customers/webs/nimg/MTstuff/modSearch.php:0
 

User avatar
Krock
Member
 
Posts: 3598
Joined: Thu Oct 03, 2013 07:48
GitHub: SmallJoker

Re: Search Minetest mods!

by Krock » Thu Mar 19, 2015 18:31

Napiophelios wrote:<snip>

Thanks for the report. The random function works correctly again.
Newest Win32 builds - Find a mod - All my mods
ALL YOUR DONATION ARE BELONG TO PARAMAT (Please support him and Minetest)
New DuckDuckGo !bang: !mtmod <keyword here>
 

Next

Return to Minetest-Related

Who is online

Users browsing this forum: No registered users and 5 guests

cron